wassname/pytorch-lightning
1
0
Fork 0
mirror of https://github.com/wassname/pytorch-lightning.git synced 2026-09-10 12:21:57 +08:00
Code Issues Packages Projects Releases Wiki Activity

added single gpu train doc

Browse Source
This commit is contained in:
William Falcon
2019-08-07 14:16:40 -04:00
parent cca6d2c65d
commit b198435d0e
1 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/Trainer/Distributed training.md
+4 -1
View File
@@ -28,9 +28,12 @@ For a deeper understanding of what lightning is doing, feel free to read [this g
Due to an issue with apex and DistributedDataParallel (PyTorch and NVIDIA issue), Lightning does Due to an issue with apex and DistributedDataParallel (PyTorch and NVIDIA issue), Lightning does
not allow 16-bit and DP training. We tried to get this to work, but it's an issue on their end. not allow 16-bit and DP training. We tried to get this to work, but it's an issue on their end.
Below are the possible configurations we support.
| 1 GPU | 1+ GPUs | DP | DDP | 16-bit | command | | 1 GPU | 1+ GPUs | DP | DDP | 16-bit | command |
|---|---|---|---|---|---| |---|---|---|---|---|---|
| Y | | | | Y | ```Trainer(gpus=[0])``` | | Y | | | | | ```Trainer(gpus=[0])``` |
| Y | | | | Y | ```Trainer(gpus=[0], use_amp=True)``` |
| | Y | Y | | | ```Trainer(gpus=[0, ...])``` | | | Y | Y | | | ```Trainer(gpus=[0, ...])``` |
| | Y | | Y | | ```Trainer(gpus=[0, ...], distributed_backend='ddp')``` | | | Y | | Y | | ```Trainer(gpus=[0, ...], distributed_backend='ddp')``` |
| | Y | | Y | Y | ```Trainer(gpus=[0, ...], distributed_backend='ddp', use_amp=True)``` | | | Y | | Y | Y | ```Trainer(gpus=[0, ...], distributed_backend='ddp', use_amp=True)``` |