Deployed df77f50 with MkDocs version: 1.0.4

2026-09-10 12:21:57 +08:00 · 2019-07-21 07:30:25 -05:00
parent 91a717e3f4
commit 10846e93a6
3 changed files with 3 additions and 2 deletions
@@ -678,7 +678,8 @@ cluster.per_experiment_nb_gpus = 8
 cluster.add_slurm_cmd(cmd='ntasks-per-node', value=8, comment='1 task per gpu')
 </code></pre>

-<p>Finally, make sure to add a distributed sampler to your dataset.    </p>
+<p>Finally, make sure to add a distributed sampler to your dataset. The distributed sampler copies a 
+portion of your dataset onto each GPU. (World_size = gpus_per_node * nb_nodes).   </p>
 <pre><code class="python"># ie: this:
 dataset = myDataset()
 dataloader = Dataloader(dataset)