Commit Graph
1997 Commits
Author SHA1 Message Date
Adrian WälchliandJirka Borovec 732eaee4d7 nan detection and intervention (#1097)
* check for nan values

* test nan detection on loss

* sys.exit

* whitespace

* detect nan and inf values in loss and params

* update

* added documentation

* moved detect nan to training loop, remove flag for print

* blank line

* test

* rename

* deprecate print_nan_grads

* deprecated print_nan_grads

* remove unused imports

* update changelog

* fix line too long

* correct deprecated version

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* raise exception instead of sysexit

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* raise exception instead of sysexit

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* Update pytorch_lightning/trainer/training_tricks.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* Update pytorch_lightning/trainer/training_tricks.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* fix test

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-03-19 09:24:45 -04:00
Jeremy Jordan 36274bed49 ensure reset method works in notebooks (#1093) 2020-03-19 09:23:18 -04:00
authmanandJirka Borovec 711892a0a2 Fix Configuring Learning Rate Schedulers (#1177)
* Update docs so users know the desired manner of configuring learning rate schedulers.

* update list

* as note

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-03-19 09:22:29 -04:00
So UchidaandJirka Borovec 01b8991c5a Support hierarchical dict (#1152)
* Add support for hierarchical dict

* Support nested Namespace

* Add docstring

* Migrate hparam flattening to each logger

* Modify URLs in CHANGELOG

* typo

* Simplify the conditional branch about Namespace

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* Update CHANGELOG.md

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* added examples section to docstring

* renamed _dict -> input_dict

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-03-19 09:15:47 -04:00
22a7264e9a improve partial Codecov (#1172)
* ignore in setup

* show report

* abs imports

* abstract pass

* cover loggers

* doctest trains

* locals

* pass

* revert tensorboard

* use tensorboardX

* revert tensorboardX

* fix trains

* Add TrainsLogger.set_credentials (#1179)

* Add TrainsLogger.set_credentials to control trains server configuration and authentication from code. Sync trains package version.
Fix CI Trains tests

* Add global TrainsLogger set_bypass_mode (#1187)

* Add global TrainsLogger set_bypass_mode skips all external communication

Co-authored-by: bmartinn <>

* rm some no-cov

Co-authored-by: Martin.B <51887611+bmartinn@users.noreply.github.com>
2020-03-19 09:14:29 -04:00
Abhinav Moudgil 73a911890b Backward compatibility for checkpoint loading (#1132)
* check if hparams_type exists in checkpoint dictionary for backward compatibility

* concisely maintain backward compatibility for hparams type

* Bug fix in checkpoint loading (#1132)
2020-03-17 18:45:36 -04:00
Jacob Zhong 1a73fa0b03 change default logger to dedicated one (#1064)
Fix test


Fix format

Update pytorch_lightning/__init__.py
Separate imports
2020-03-17 18:44:00 -04:00
William FalconandJirka Borovec c32e3f3ea5 coverage increase (#1167)
* fixed docs

* Docs (#1164)

* fixed docs

* fixed docs

* fixed docs

* fixing Win failed import (#1163)

* version

* try fix distrib

* update try import

* fixed docs

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-03-16 21:43:43 -04:00
Jirka Borovec e461ec0037 fixing Win failed import (#1163)
* version

* try fix distrib

* update try import
2020-03-16 20:50:36 -04:00
William Falcon 49d000c0c9 Docs (#1164)
* fixed docs

* fixed docs

* fixed docs
2020-03-16 20:50:14 -04:00
Jirka Borovec c89e482f85 prune codecov exceptions (#1107) 2020-03-16 14:40:34 -04:00
Nicki SkafteandNicki Skafte 384e124490 ReduceLROnPlateau bug fix (#1126)
* bug fix and test

* update CHANGELOG.md

Co-authored-by: Nicki Skafte <nugginea@gmail.com>
2020-03-16 14:35:10 -04:00
Jirka Borovec 774d9be357 Fix docs - missing Trainer (#1159)
* drop pandas

* formatting
2020-03-15 19:46:39 -04:00
Jakub 3ad6169f18 Neptune Logger Improvements (#1084)
* removed project and experiment from getstate

* added tests for closing experiment, updated token in example to user neptuner

* updated teoken

* Update neptune.py

added a link to example experiment

* added exmaple experiment link

* dropped duplication

* flake fixes

* merged with master, added changes information to CHANGELOG
2020-03-14 13:02:40 -04:00
Ibraheem Moosa 2232eb35d1 Fix examples that uses type_as (#1129) 2020-03-14 13:02:31 -04:00
c0bedd2587 Add TRAINS experiment manager support (#1122)
* Add allegro.ai TRAINS experiment manager support

* improve docstring and type hinting, fix the bug in log_metrics, add support torch.Tensor to input into log_image

* complete missing docstring of constructor's arguments

* fix docs

* pep8

* pep8

* remove redundant typing
use logging
fix typing and pep8

* remove deprecated interface

* add TrainsLogger test

* add TrainsLogger PR in CHANGELOG

* add id/name property documentation

* change logging as log

Co-authored-by: bmartinn <>
Co-authored-by: Sou Uchida <s.aiueo32@gmail.com>
2020-03-14 13:02:14 -04:00
da61398835 Add Support for Non-primitive types in TensorboardLogger (#1130)
* Added support for non-primitive types to tensorboard logger

* added EOF newline

* PEP8

* Updated CHANGELOG for PR #1130. Moved _sanitize_params to base logger. Cleaned up _sanitize_params

* Updated CHANGELOG for PR #1130. Moved _sanitize_params to base logger. Cleaned up _sanitize_params

* changed convert_params to static method

* PEP8

* Cleanup Doctest for _sanitize_params

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* Removed OrderedDict import

* Updated import order to conventions

Co-authored-by: Manbir Gulati <manbirgulati@Manbirs-MBP.hsd1.md.comcast.net>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-03-14 13:02:05 -04:00
Jirka Borovec f6a7a5278a enable Codecov (#1133)
* update config

* try Drone cache

* drop Drone cache

* move import

* remove token
2020-03-14 13:01:57 -04:00
3c2fd560aa Type Hints for Lightning Core (#946)
* first pass for LightningModule typehints

* fix return types

* add missing types

* add type annotations to grads.py

* add type annotations to hooks.py

* add type annotation to memory.py

* proper docstring quotation marks

* add type annotations to saving.py

* fix cyclic import problem

* fix cyclic import problem

* add missing whitespace

* finish type hints for load_from_ methods

* docs: prepare_data does not return anything

* fix auto types in docs

* revert typehint for trainer in hook

* remove unnecessary return docs

* some fixes for memory docs

* revert typing for args kwargs

* added all missing None return types

* remove unused import

* add more details to dict/list return types

* fix line too long

* optimize imports

* linted

* Revert "linted"

This reverts commit 85559611e84e312bce64f4e73b638d4999a8439e.

* remove whitespace

* update

* update

* update

* update

* update

* changelog

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-03-12 12:47:23 -04:00
Jirka Borovec 1d5f06223a fix tmpdir (#1012)
* fix tmpdir

* just str path
2020-03-12 12:46:25 -04:00
Ethan Harris 2b3f443f6b Add support for IterableDatasets everywhere (#1104)
* Add support for IterableDatasets everywhere

* Added type hints, simplified code and improved coverage in data_loading.py

* Update CHANGELOG.md
2020-03-12 12:46:02 -04:00
Ondrej Platek 1383f64a5f fix max_epochs setup in basic example (#1105)
tested only for the CPU version
2020-03-12 12:42:52 -04:00
Christabella Irwanto fb27a771f8 Fix typo (#1118) 2020-03-12 12:42:09 -04:00
Jirka Borovec 514d182b7f cleaning imports (#1032) 2020-03-12 12:41:37 -04:00
So Uchida 322e7157e0 set the default value of progress_bar_refresh_rate to 1 (#1100) 2020-03-12 12:40:30 -04:00
Jirka Borovec ed0b890e75 update info for GPU (#1021) 2020-03-12 12:36:46 -04:00
Xing Zhao LEEandxingzhaolee b4d4e489bf Run on_validation_end only on main process in DDP (#1125)
Co-authored-by: xingzhaolee <xingzhaolee@users.noreply.github.com>
2020-03-12 15:50:00 +01:00
Heon Song b29613b758 fix typo (#1124) 2020-03-12 15:49:27 +01:00
Jirka Borovec 9255e54acb prune changelog (#1123) 2020-03-12 15:48:51 +01:00
J. Borovec 5e013f6e2f suspend PR greeting 2020-03-11 21:41:18 +01:00
Jirka Borovec 5691ffb160 add Drone CI (#1115)
* add Drone config

* update Drone config

* add Drone config

* list GPUs

* add type

* native torch

* native torch

* fix image

* update

* SLURM_LOCALID

* add badge

* simple test
2020-03-11 15:39:59 -04:00
Jirka Borovec bc01b9ac1c update chnagelog (#1091)
* update chnagelog

* update chnagelog
2020-03-10 11:15:03 -04:00
William Falcon 620941eb28 Update README.md 2020-03-07 07:19:59 -05:00
Jirka Borovec 0cdfb9af41 reduce nb CI builds (#1078) 2020-03-06 19:19:19 -05:00
William Falcon 3854afdc3e Update README.md 2020-03-06 19:16:29 -05:00
William Falcon af621f8590 release v0.7.1 2020-03-06 18:23:04 -05:00
William Falcon 21057d0064 Fixes print issues and data_loader (#1080)
* print issue

* print issue

* print issue

* print issue

* print issue
2020-03-06 18:14:03 -05:00
William Falcon 3223e71b30 Update README.md 2020-03-06 16:31:04 -05:00
William Falcon e17c72148e release v0.7.0 2020-03-06 16:19:51 -05:00
William Falcon 38e9fabdd5 release v0.6.4.dev1 2020-03-06 16:15:33 -05:00
Jirka BorovecandWilliam Falcon 4896815067 remove deprecated data_loader (#1077)
* change version in CHangelog

* warning

* remove der data_loader

Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-03-06 16:11:05 -05:00
William Falcon 3d18099262 removed decorators (#1079) 2020-03-06 16:09:47 -05:00
William Falcon 2bc01a00e8 dev release 1 2020-03-06 16:04:54 -05:00
William Falcon 21ac476b17 release v 2020-03-06 21:36:59 +01:00
William Falcon 0d5f7671e0 updated docs 2020-03-06 21:36:59 +01:00
William FalconandJirka Borovec be89eb07c8 cleaned docs, fixed argparse generator (#1075)
* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Test deprecated API for 0.8.0 and 0.9.0 (#1071)

* till 0.8

* refactor

* fix tests

* fix tests

* deprx till 0.9

* Update trainer.py

* Apply suggestions from code review

Co-authored-by: William Falcon <waf2107@columbia.edu>

* updated test

* updated test

* updated test

* updated test

* updated test

* updated test

* updated test

* updated test

* updated test

* updated test

* updated test

* updated test

* updated test

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-03-06 21:36:59 +01:00
William Falcon 9f140b7698 updated test (#1073) 2020-03-06 21:36:59 +01:00
Jirka BorovecandWilliam Falcon ff1f8ef400 Test deprecated API for 0.8.0 and 0.9.0 (#1071)
* till 0.8

* refactor

* fix tests

* fix tests

* deprx till 0.9

* Update trainer.py

* Apply suggestions from code review

Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-03-06 21:36:44 +01:00
William Falcon 10311c48b7 Update README.md 2020-03-06 21:36:44 +01:00
Adrian WälchliandWilliam Falcon 09482fb64f Fix Inconsistencies after introducing *_step_end and *_epoch_end (#1072)
* fix copy-paste errors after renaming *_end methods

* line too long

* update

* Update lightning.py

* Update lightning.py

* Update lightning.py

Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-03-06 10:33:17 -05:00