From df77f5042b0c773420c15a1930b445a74e6de120 Mon Sep 17 00:00:00 2001 From: William Falcon Date: Sun, 21 Jul 2019 08:30:17 -0400 Subject: [PATCH] updated docs --- docs/Trainer/Distributed training.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/docs/Trainer/Distributed training.md b/docs/Trainer/Distributed training.md index 5a04252b..486dd6c6 100644 --- a/docs/Trainer/Distributed training.md +++ b/docs/Trainer/Distributed training.md @@ -87,7 +87,8 @@ cluster.per_experiment_nb_gpus = 8 cluster.add_slurm_cmd(cmd='ntasks-per-node', value=8, comment='1 task per gpu') ``` -Finally, make sure to add a distributed sampler to your dataset. +Finally, make sure to add a distributed sampler to your dataset. The distributed sampler copies a +portion of your dataset onto each GPU. (World_size = gpus_per_node * nb_nodes). ```python # ie: this: