simplify examples structure (#1247)

* simplify examples structure

* update changelog

* fix imports

* rename example

* rename scripts

* changelog
This commit is contained in:
Jirka Borovec
2020-04-03 17:57:34 -04:00
committed by GitHub
parent 16f4cc9ff0
commit 22bedf9b57
20 changed files with 138 additions and 84 deletions
+25 -2
View File
@@ -1,4 +1,4 @@
# Basic Examples
## Basic Examples
Use these examples to test how lightning works.
#### Test on CPU
@@ -36,4 +36,27 @@ On a single node, uses all GPUs for 1 model. Then shares gradient information
across nodes.
```bash
python gpu_template.py --gpus 2 --distributed_backend ddp2
```
```
# Multi-node example
This demo launches a job using 2 GPUs on 2 different nodes (4 GPUs total).
To run this demo do the following:
1. Log into the jumphost node of your SLURM-managed cluster.
2. Create a conda environment with Lightning and a GPU PyTorch version.
3. Choose a script to submit
#### DDP
Submit this job to run with DistributedDataParallel (2 nodes, 2 gpus each)
```bash
sbatch ddp_job_submit.sh YourEnv
```
#### DDP2
Submit this job to run with a different implementation of DistributedDataParallel.
In this version, each node acts like DataParallel but syncs across nodes like DDP.
```bash
sbatch ddp2_job_submit.sh YourEnv
```