Nicki Skafte and Nicki Skafte
88f816ed06
dummy logger ( #1836 )
...
Co-authored-by: Nicki Skafte <nugginea@gmail.com >
2020-05-14 10:34:11 -04:00
William Falcon
5bb6b41b78
dataloaders with fast_dev_run ( #1787 )
...
* dataloaders with fast_dev_run
* dataloaders with fast_dev_run
* dataloaders with fast_dev_run
* fix
* pep 8
2020-05-11 23:32:44 -04:00
4970927ec8
Feature: auto scale batch size ( #1638 )
...
* auto batch finder
* fix styling
* add description
* add different modes
* fix copy paste error
* better organised code
* fix styling
* add tests
* fix
* fix
* add some documentation
* added CHANGELOG.md
* some documentation
* update based on review
* Update trainer.py
* Update docs/source/training_tricks.rst
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com >
* Update tests/trainer/test_trainer_tricks.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com >
* Update tests/trainer/test_trainer_tricks.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com >
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com >
* use EvalModelTemplate
* param tests
* rename
* wrap params
* rename function
* rename
* rename param
* fix
* abs
* rename
* refactor code
* add docs
* try
* arg
* loop
* exept
* loop
* drop bool
* docs
* docs
* added check and test for passing dataloader to fit
* styling fix
* update based on review
Co-authored-by: Nicki Skafte <nugginea@gmail.com >
Co-authored-by: William Falcon <waf2107@columbia.edu >
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com >
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com >
Co-authored-by: Jirka <jirka.borovec@seznam.cz >
2020-05-09 08:28:36 -04:00
29ebe92208
support for native amp ( #1561 )
...
* adding native amp suppport
* adding native amp suppport
* adding native amp suppport
* adding native amp suppport
* autocast
* autocast
* autocast
* autocast
* autocast
* autocast
* removed comments
* removed comments
* added state saving
* added state saving
* try install amp again
* added state saving
* drop Apex reinstall
Co-authored-by: J. Borovec <jirka.borovec@seznam.cz >
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com >
2020-04-23 14:47:08 -04:00
Jonas-Jaeger
e02146943d
Removed redundant computations in clip_gradients that slowed down the gradient clipping. ( #1523 )
...
Fixes #1522
2020-04-18 23:07:15 -04:00
Alex Sergeev
8dd9b80d7a
Fix gradient clipping ( #1438 )
...
* Fix gradient clipping
* Relax accuracy constraint
2020-04-09 21:08:28 -04:00
Adrian Wälchli and Jirka Borovec
732eaee4d7
nan detection and intervention ( #1097 )
...
* check for nan values
* test nan detection on loss
* sys.exit
* whitespace
* detect nan and inf values in loss and params
* update
* added documentation
* moved detect nan to training loop, remove flag for print
* blank line
* test
* rename
* deprecate print_nan_grads
* deprecated print_nan_grads
* remove unused imports
* update changelog
* fix line too long
* correct deprecated version
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com >
* raise exception instead of sysexit
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com >
* raise exception instead of sysexit
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com >
* Update pytorch_lightning/trainer/training_tricks.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com >
* Update pytorch_lightning/trainer/training_tricks.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com >
* fix test
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com >
2020-03-19 09:24:45 -04:00
Jacob Zhong
1a73fa0b03
change default logger to dedicated one ( #1064 )
...
Fix test
Fix format
Update pytorch_lightning/__init__.py
Separate imports
2020-03-17 18:44:00 -04:00
Jirka Borovec
514d182b7f
cleaning imports ( #1032 )
2020-03-12 12:41:37 -04:00
4c5e82c065
Skepticleo trainer argparser ( #1023 )
...
* Added default parser for trainer and class method to construct trainer from default args
* Removed print statement
* Added test for constructing Trainer from command line args
* Removed extra line
* Removed redundant imports, removed whitespace from empty lines
* Fixed typo
* Updated default parser creation to get class attributes automatically
* Updated default parser creation to get class attributes automatically
* Added method to get default args for trainer
* Trimmed trainer get default args method
* Updated from argparse method to not return trainer with static arguments
* Update trainer get default args to classmethod
* adjustment
* fix
* Fixed variable name
* Update trainer.py
* Update test_trainer.py
* Update trainer.py
* Update tests/trainer/test_trainer.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com >
* Update trainer.py
* Update test_trainer.py
* Update trainer.py
* Update test_trainer.py
* Update tests/trainer/test_trainer.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com >
* Update pytorch_lightning/trainer/trainer.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com >
* Update trainer.py
* Update test_trainer.py
Co-authored-by: Mudit Tanwani <mudittanwani@gmail.com >
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com >
2020-03-03 09:32:15 -05:00
Jirka Borovec
7beed7cae6
Trainer cleanup ( #934 )
...
* Trainer cleanup
* update abstract
* remove ...
* remove __init__
* update mixin types
* update callbacks
* fix
* lower test acc
2020-02-27 16:21:14 -05:00
srush and Jirka Borovec
27a3be0287
TPU gradient clipping. ( #963 )
...
* clip
* Update pytorch_lightning/trainer/training_tricks.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com >
* Update pytorch_lightning/trainer/training_tricks.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com >
* pull out epsilon
* add fp16 case
* Update pytorch_lightning/trainer/training_tricks.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com >
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com >
2020-02-27 15:46:47 -05:00
Hadrien Mary
be244560b2
Callbacks [wip] ( #889 )
...
* Add callback system + associated test
* Add trainer and pl_module args to callback methods
* typing
* typo in docstring
* Switch to on_.*_start()
* fix on_test_start
* fix the mess after rebasing
2020-02-25 23:17:27 -05:00
Vadim Bereznyuk
edd4a87fb0
Refactor callbacks ( #776 )
...
* Refactor callbacks
* flake8
* Update docstrings
* Simplified callback, protected trainer
* .set_trainer() check
* update docs
* missed super().__ini__()
* Updated tests
* Use uppercase
* refine checkpoint callback tests
* Added test_begin() and test_end()
2020-02-16 00:03:05 -05:00
Jirka Borovec
76a1c67d87
rename logging -> loggers ( #767 )
...
* move logging >> loggers
* add warning
* fix tests
* logging alias
* formatting
* formatting
2020-02-01 15:47:58 -05:00
Jirka Borovec
ea59a99426
update org paths & convert logos ( #685 )
...
* fix typos
* update org paths
* update links from READMe to docs
* add svg logo
* add svg logo-text
* update logos
* testing temp paths
* prune links from readme
* optimize imports
* update logo
* update paths in README
* missing imports
2020-01-20 14:50:31 -05:00
Jirka Borovec
1d4b6be17b
rename trainer modules, drop _mixin ( #571 )
...
* rename trainer modules, drop _mixin
* fix imports
2019-12-04 11:39:14 -05:00
