wassname/pytorch-lightning
1
0
Fork 0
mirror of https://github.com/wassname/pytorch-lightning.git synced 2026-09-10 12:21:57 +08:00
Code Issues Packages Projects Releases Wiki Activity

Deployed df77f50 with MkDocs version: 1.0.4

Browse Source
This commit is contained in:
William Falcon
2019-07-21 07:30:25 -05:00
parent 91a717e3f4
commit 10846e93a6
3 changed files with 3 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
Trainer/Distributed training/index.html
+2 -1
View File
@@ -678,7 +678,8 @@ cluster.per_experiment_nb_gpus = 8
cluster.add_slurm_cmd(cmd='ntasks-per-node', value=8, comment='1 task per gpu')
</code></pre>
<p>Finally, make sure to add a distributed sampler to your dataset. </p>
<p>Finally, make sure to add a distributed sampler to your dataset. The distributed sampler copies a
portion of your dataset onto each GPU. (World_size = gpus_per_node * nb_nodes). </p>
<pre><code class="python"># ie: this:
dataset = myDataset()
dataloader = Dataloader(dataset)