added gradient clipping

This commit is contained in:
William Falcon
2019-06-28 18:00:57 -04:00
parent d9e7174a7b
commit a86ce398a9
7 changed files with 51 additions and 298 deletions
+10
View File
@@ -38,6 +38,16 @@ Use this to turn off early stopping and run training to the [max_epoch](#force-t
trainer = Trainer(enable_early_stop=True)
```
---
#### Gradient Clipping
Use this to turn off early stopping and run training to the [max_epoch](#force-training-for-min-or-max-epochs)
``` {.python}
# DEFAULT (ie: don't clip)
trainer = Trainer(gradient_clip=0)
```
---
#### Inspect gradient norms
Looking at grad norms can help you figure out where training might be going wrong.