cleaned up demos

This commit is contained in:
William Falcon
2019-10-05 14:15:09 -04:00
parent 4d3a8c25d2
commit 94f89e8e10
+8 -9
View File
@@ -1,36 +1,35 @@
# Basic Examples
Use these examples to test how lightning works.
### Test on CPU
#### Test on CPU
```bash
python cpu_template.py
```
### Test on GPUs
This demo can train on a single GPU, multiple GPUs or multiple nodes by
passing in different flags.
##### Train on a single GPU
---
#### Train on a single GPU
```bash
python gpu_template.py --gpus 1
```
---
##### DataParallel (dp)
#### DataParallel (dp)
Train on multiple GPUs using DataParallel.
```bash
python gpu_template.py --gpus 2 --distributed_backend dp
```
##### DistributedDataParallel (ddp)
---
#### DistributedDataParallel (ddp)
Train on multiple GPUs using DistributedDataParallel
```bash
python gpu_template.py --gpus 2 --distributed_backend ddp
```
##### DistributedDataParallel+DP (ddp2)
---
#### DistributedDataParallel+DP (ddp2)
Train on multiple GPUs using DistributedDataParallel + dataparallel.
On a single node, uses all GPUs for 1 model. Then shares gradient information