wassname/pytorch-lightning
1
0
Fork 0
mirror of https://github.com/wassname/pytorch-lightning.git synced 2026-09-09 11:32:07 +08:00
Code Issues Packages Projects Releases Wiki Activity

Deployed 09d4475 with MkDocs version: 1.0.4

Browse Source
This commit is contained in:
William Falcon
2019-08-09 14:03:22 -05:00
parent d43f670f3c
commit caeca5da25
5 changed files with 22 additions and 18 deletions
Download Patch File Download Diff File Expand all files Collapse all files
Trainer/Training Loop/index.html
+5 -1
View File
@@ -627,9 +627,13 @@ trainer = Trainer(enable_early_stop=True)
<hr />
<h4 id="gradient-clipping">Gradient Clipping</h4>
<p>Use this to turn off early stopping and run training to the <a href="#force-training-for-min-or-max-epochs">max_epoch</a></p>
<p>Gradient clipping may be enabled to avoid exploding gradients.
Specifically, this will <a href="https://pytorch.org/docs/stable/nn.html#torch.nn.utils.clip_grad_norm_">clip the gradient norm computed over all model parameters <em>together</em></a>.</p>
<pre><code class="python"># DEFAULT (ie: don't clip)
trainer = Trainer(gradient_clip=0)
# clip gradients with norm above 0.5
trainer = Trainer(gradient_clip=0.5)
</code></pre>
<hr />