Add toma comments to auto_scale_batch_size (#1994)

* Add source comments

* Update training_tricks.rst
This commit is contained in:
Andreas Kirsch
2020-05-29 05:57:50 +00:00
committed by GitHub
parent cd3fed03a2
commit 3af3f37d43
2 changed files with 6 additions and 1 deletions
+1 -1
View File
@@ -39,7 +39,7 @@ Auto scaling of batch size
--------------------------
Auto scaling of batch size may be enabled to find the largest batch size that fits into
memory. Larger batch size often yields better estimates of gradients, but may also result in
longer training time.
longer training time. Inspired by https://github.com/BlackHC/toma.
.. seealso:: :class:`~pytorch_lightning.trainer.trainer.Trainer`