added gradient clipping

This commit is contained in:
William Falcon committed 2019-06-28 18:00:57 -04:00
1 parent d9e7174a7b
commit a86ce398a9
7 files changed
+51 -298

No files matched your search

+10
View File
@@ -38,6 +38,16 @@ Use this to turn off early stopping and run training to the [max_epoch](#force-t
trainer = Trainer(enable_early_stop=True)
```
---
#### Gradient Clipping
Use this to turn off early stopping and run training to the [max_epoch](#force-training-for-min-or-max-epochs)
``` {.python}
# DEFAULT (ie: don't clip)
trainer = Trainer(gradient_clip=0)
```
---
#### Inspect gradient norms
Looking at grad norms can help you figure out where training might be going wrong.