From 94f89e8e103d81c319b9e76d44fabd03c09db630 Mon Sep 17 00:00:00 2001 From: William Falcon Date: Sat, 5 Oct 2019 14:15:09 -0400 Subject: [PATCH] cleaned up demos --- examples/basic_examples/README.md | 17 ++++++++--------- 1 file changed, 8 insertions(+), 9 deletions(-) diff --git a/examples/basic_examples/README.md b/examples/basic_examples/README.md index f23be2df..4e8e9b47 100644 --- a/examples/basic_examples/README.md +++ b/examples/basic_examples/README.md @@ -1,36 +1,35 @@ # Basic Examples Use these examples to test how lightning works. -### Test on CPU +#### Test on CPU ```bash python cpu_template.py ``` -### Test on GPUs -This demo can train on a single GPU, multiple GPUs or multiple nodes by -passing in different flags. - -##### Train on a single GPU +--- +#### Train on a single GPU ```bash python gpu_template.py --gpus 1 ``` --- -##### DataParallel (dp) +#### DataParallel (dp) Train on multiple GPUs using DataParallel. ```bash python gpu_template.py --gpus 2 --distributed_backend dp ``` -##### DistributedDataParallel (ddp) +--- +#### DistributedDataParallel (ddp) Train on multiple GPUs using DistributedDataParallel ```bash python gpu_template.py --gpus 2 --distributed_backend ddp ``` -##### DistributedDataParallel+DP (ddp2) +--- +#### DistributedDataParallel+DP (ddp2) Train on multiple GPUs using DistributedDataParallel + dataparallel. On a single node, uses all GPUs for 1 model. Then shares gradient information