From b198435d0ef7f73b671df85a8fef1d9ee5841a9e Mon Sep 17 00:00:00 2001 From: William Falcon Date: Wed, 7 Aug 2019 14:16:40 -0400 Subject: [PATCH] added single gpu train doc --- docs/Trainer/Distributed training.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/docs/Trainer/Distributed training.md b/docs/Trainer/Distributed training.md index b59f26c8..1f24c3c9 100644 --- a/docs/Trainer/Distributed training.md +++ b/docs/Trainer/Distributed training.md @@ -28,9 +28,12 @@ For a deeper understanding of what lightning is doing, feel free to read [this g Due to an issue with apex and DistributedDataParallel (PyTorch and NVIDIA issue), Lightning does not allow 16-bit and DP training. We tried to get this to work, but it's an issue on their end. +Below are the possible configurations we support. + | 1 GPU | 1+ GPUs | DP | DDP | 16-bit | command | |---|---|---|---|---|---| -| Y | | | | Y | ```Trainer(gpus=[0])``` | +| Y | | | | | ```Trainer(gpus=[0])``` | +| Y | | | | Y | ```Trainer(gpus=[0], use_amp=True)``` | | | Y | Y | | | ```Trainer(gpus=[0, ...])``` | | | Y | | Y | | ```Trainer(gpus=[0, ...], distributed_backend='ddp')``` | | | Y | | Y | Y | ```Trainer(gpus=[0, ...], distributed_backend='ddp', use_amp=True)``` |