178 Commits

Include renames

Author	SHA1	Message	Date
NicEggert	46e549c604	Save and load hparams from checkpoints	2019-10-22 15:48:25 -05:00
Jirka Borovec	f18aee30a5	Minor imports cleaning (#402) ... * code cleaning * drop unused imports * optimize imports	2019-10-22 11:32:40 +03:00
William Falcon	1424157731	Refactor (#407) ... * moved dp, ddp outside of trainer * added main mixins * finished major mixin refactor * flake8 * finished major mixin refactor * finished major mixin refactor * finished major mixin refactor * finished major mixin refactor * finished major mixin refactor * finished major mixin refactor * finished major mixin refactor	2019-10-22 04:16:51 +03:00
William Falcon	b0281395bf	changes examples to pl_examples for name connflict	2019-10-19 00:41:17 +02:00
William Falcon	699bd2cb50	removed mlflow and custom logger tests (#389) ... * changes to seed for tests * changes to seed for tests * changes to seed for tests * changes to seed for tests * changes to seed for tests * changes to seed for tests * changes to seed for tests * changes to seed for tests * changes to seed for tests * changes to seed for tests * changes to seed for tests * changes to seed for tests * changes to seed for tests * changes to seed for tests * changes to seed for tests	2019-10-18 23:03:28 +02:00
William Falcon	c6dde49296	changed lbfgs test min acc	2019-10-18 09:51:33 +02:00
William Falcon	d29a693590	changed lbfgs test	2019-10-18 02:15:04 +02:00
William Falcon	65a2cf6104	changed lbfgs test	2019-10-18 01:31:45 +02:00
William Falcon	d8920169ac	dp tests	2019-10-18 01:06:50 +02:00
William Falcon	2044126821	fixing tests (#372) ... * fixing tests * fixing tests * fixing tests * fixing tests * fixing tests * fixing tests * fixing tests * fixed tests * fixed tests * fixed tests * fixed tests * fixed tests * fixed tests * fixed tests * fixed tests * fixed tests	2019-10-16 07:28:47 -04:00
William Falcon	e2cabb03ba	fix val logging (#362) ... * fix test * fix test * fix test * fix test * fix test * fix test * fix test * fix test * fix test * fix test * fix test * fix test * fix test * no warnings always * no warnings always * no warnings always * no warnings always	2019-10-15 12:44:20 -04:00
William Falcon	a94e9d8e12	Update test_models.py	2019-10-10 15:17:19 -04:00
William Falcon	46322b906b	fixed ckpt tests (#352) ... * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests * fixed ckpt tests	2019-10-10 15:16:19 -04:00
William Falcon	ec10119e97	Fixed tests (#340) ... * removed hparam calls * removed hparam calls * removed hparam calls * removed hparam calls * removed hparam calls * Update test_models.py	2019-10-09 10:37:10 -04:00
William Falcon	49e04de5ac	Ports (#338) ... * remove os.exit from early stopping * remove os.exit from early stopping * fixed weight summary * fixed weight summary * fixed weight summary * fixed weight summary * fixed weight summary * fixed weight summary * fixed weight summary	2019-10-08 17:11:47 -04:00
William Falcon	491100abdd	Docs (#315) ... * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up demos * cleaning up docs * cleaned up test_tube logger * cleaned up test_tube logger * cleaned up test_tube logger	2019-10-05 23:52:32 -04:00
William Falcon	6cc3f1757f	decouple returns from each step (#307) ... * decoupled training metrics from logging metrics * decoupled validation metrics from log metrics * updated docs * updated docs * updated docs * Fixed test * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master * merged master	2019-10-05 13:35:20 -04:00
William Falcon	8f5a06bfb8	Gpu mem (#308) ... * Fixes #289 * Fixes #289 * added lbfgs support * Fixes #280 (#309) * added test seeds (#306) * added test seeds * added test seeds * updated docs * added lbfgs support (#310) * added lbfgs support * added lbfgs support * added lbfgs support * Fixes #280 (#309) * added test seeds (#306) * added test seeds * added test seeds * updated docs * added lbfgs support * added lbfgs support * added lbfgs support * added lbfgs support * added lbfgs support * added lbfgs support * added lbfgs support * added lbfgs support * Fixes #289 * Fixes #289 * merged master * merged master	2019-10-05 11:29:34 -04:00
William Falcon	75fd89106f	added lbfgs support (#310) ... * added lbfgs support * added lbfgs support * added lbfgs support * Fixes #280 (#309) * added test seeds (#306) * added test seeds * added test seeds * updated docs * added lbfgs support * added lbfgs support * added lbfgs support * added lbfgs support * added lbfgs support * added lbfgs support * added lbfgs support * added lbfgs support	2019-10-05 11:10:21 -04:00
William Falcon	c9786cdef1	added test seeds (#306) ... * added test seeds * added test seeds * updated docs	2019-10-05 10:56:52 -04:00
William Falcon	967957e55c	added lbfgs support	2019-10-05 10:47:18 -04:00
William Falcon	bf09060fef	Fixes #292 (#303) ... * early stopping callback is not default * added a default logger * added default checkpoint callback * added default checkpoint/loggers * added default checkpoint/loggers * updated docs * cleaned demos * cleaned demos * cleaned demos * clean up docs around loggers * clean up docs around loggers * clean up docs around loggers * clean up docs around loggers * clean up docs around loggers * clean up docs around loggers * clean up docs around loggers * clean up docs around loggers * clean up docs around loggers * clean up docs around loggers * clean up docs around loggers * clean up docs around loggers * clean up docs around loggers	2019-10-04 19:48:57 -04:00
William Falcon	033be9e9b4	tests fix	2019-10-04 17:32:52 -04:00
William Falcon	3a3ac73963	Merge branch 'master' of https://github.com/williamFalcon/pytorch-lightning	2019-10-04 16:56:05 -04:00
William Falcon	cf07c153e9	tests fix	2019-10-04 16:55:51 -04:00
William Falcon	a60a24d11b	disable auto gpu loading when restoring weights to avoid OOM (#242) ... * Update root_module.py * Update root_module.py * Update root_module.py * tests fix * tests fix	2019-10-04 16:18:43 -04:00
William Falcon	73a7cf3c99	Mem crash (#299) ... * fixes memory crash * fixes memory crash	2019-10-04 15:53:44 -04:00
Hendrik Schröter	36f0b5bbd0	Use getter instead of python property for the dataloaders (#275) ... * Use getter instead of python property for the dataloaders * Fix lint * Update trainer.py	2019-10-04 15:35:02 -04:00
William Falcon	32e74b8f36	Ddp2 (#261) ... * adds ddp2 option where on each node a single process uses all gpus * added ddp2 test * added ddp2 docs * Update Distributed training.md * delete ref to old update_training_log_metrics * delete ref to old update_training_log_metrics * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * banana pancakes * debug * debug * debug * debug * debug * debug * debug * debug * cheesecake	2019-10-04 15:07:54 -04:00
Nic Eggert	480eed5cb6	Enable any ML experiment tracking framework (#223) ... * Implement generic loggers for experiment tracking * Add tests for loggers * Get model tests passing * Test and fix logger pickling * Expand pickle test and fix bug * Missed exp -> logger conversion * Remove commented code * Add docstrings * Update logging docs * Add mlflow to test requirements * Make linter happy * Fix mlflow timestamp * Update Logging.md * Update test_models.py * Update test_models.py * Update test_models.py * Update properties.md * Fix tests * Line length	2019-09-27 12:05:29 -04:00
William Falcon	481aa24974	always calls the lr scheduler with epoch nb. Fixes #98 (#252) ... * always calls the lr scheduler with epoch nb * added docs for cluster grid search * added docs for cluster grid search * undo test changes * undo test changes	2019-09-26 16:36:41 -04:00
William Falcon	cf04ff73e9	undo test changes	2019-09-26 16:10:51 -04:00
William Falcon	de9fc0587b	added docs for cluster grid search	2019-09-26 16:10:16 -04:00
William Falcon	25d2f93256	enables samplers which don't need set epoch (or when ppl don't need a sampler) (#254) ... * enables samplers which dont need set epoch * added docs for single gpu ddp * added docs for single gpu ddp * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search * added docs for cluster grid search	2019-09-26 14:39:04 -04:00
Alok Singh	b0a0a47a0b	Rename variables (#124) ... - data_batch → batch - batch_i → batch_idx - dataloader_i → dataloader_idx - tng → training - training_dataloader → train_dataloader - add_log_row_interval → row_log_interval - gradient_clip → gradient_clip_val - prog → progress - tqdm_dic → tqdm_dict	2019-09-25 19:05:06 -04:00
William Falcon	55e7322747	Metrics load (#228) ... * load from metrics defaults to CPU * load from metrics defaults to CPU * load from metrics defaults to CPU	2019-09-16 10:47:19 -04:00
William Falcon	9576dd28b2	added load on CPU first (#221) ... * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added load on CPU first * added print logs * added print logs * changed close order * changed close order	2019-09-11 07:52:36 -04:00
William Falcon	506d5da68b	enable single gpu per node (#218) ... * enable single gpu per node * enable single gpu per node * enable single gpu per node * enable single gpu per node * enable single gpu per node * enable single gpu per node	2019-09-09 07:37:20 -04:00
William Falcon	10d190e045	Simplified gpu api. No NVIDIA flag managing by lightning for cluster (#213) ... * added nvidia flag set * added nvidia flag set * added nvidia flag set * added nvidia flag set * added nvidia flag set * added nvidia flag set * added nvidia flag set * added nvidia flag set * added simple cluster template * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs * sets correct backend for possible combinations of gpu inputs	2019-09-08 15:36:58 -04:00
William Falcon	7099f8dbfb	split trainer mixins (#209) ... * split trainer mixins * Update multi_node_cluster_template.py * Update single_cpu_template.py * Update single_gpu_node_16bit_template.py * Update single_gpu_node_ddp_template.py * Update single_gpu_node_dp_template.py * Update trainer_cpu_template.py * Update trainer_io.py * split trainer mixins * Update multi_node_cluster_template.py * deconflicted * deconflicted * deconflicted	2019-09-06 14:11:07 -04:00
William Falcon	60633eaa32	Moves hpc auto-resubmit to trainer from test-tube (#207) ... * added slurm signal handler * added restore weight functions * set slurm signal handling inside process * added resubmit docs * added resubmit docs * fixed missing param * Update trainer.py * fixed missing param * fixed missing param * debugging tests * debugging tests * debugging tests * debugging tests * debugging tests * debugging tests * debugging tests	2019-09-06 11:54:51 -04:00
Nic Eggert	1733dba735	Pass outputs from all dataloaders to test_end and validation_end (#203) ... * Pass outputs from all dataloaders to test_end and validation_end * Update tests * Update docs * Update trainer.py * Update test_models.py	2019-09-06 07:37:25 -04:00
Nic Eggert	64688e1e15	Refactor test modules (#180) ... * Expectopatronum implement #89 (#182) * rename validate -> evaluate; implement test logic; allow multiple test_loaders * add test_step and test_end to LightningModule * add in_test_mode to pretraining to implement case 2 (test pretrained model) * fix code style issues * LightningTestModel: add optional second test set, implement test_step and test_end * implemented test for multiple test_dataloaders; fixed typo * add two test cases for #89 * add documentation for test_step, test_end; fix computation of loss in validation_step example * Update trainer.py * Update trainer.py * Update trainer.py * Update trainer.py * Update trainer.py * Update trainer.py * Added proper dp ddp routing calls for test mode * Update trainer.py * Update test_models.py * Update trainer.py * Update trainer.py * Update override_data_parallel.py * Update test_models.py * Update test_models.py * Update trainer.py * Update trainer.py * Update trainer.py * Update test_models.py * Update test_models.py * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * Update trainer.py * Update override_data_parallel.py * Update debug.py * Update lm_test_module.py * Update test_models.py * release v0.4.8 * Update README.md * add training loop docs * testing loop docs * testing loop docs * Convert __dataloader to _dataloader This will let inherited classes use it * Factor common test model setup into base class * Specialized test modules inherit from LightningTestModelBase * Fix __is_overriden so that it works with more complicated inheritance * Use mixins to add functionality to test models * Fix test with no val_dataloader * Remove unused imports * Get rid of wild card import * Update trainer.py * Update lm_test_module.py	2019-09-02 15:46:16 -04:00
Verena Haunschmid	25d5b25792	Expectopatronum implement #89 (#182) ... * rename validate -> evaluate; implement test logic; allow multiple test_loaders * add test_step and test_end to LightningModule * add in_test_mode to pretraining to implement case 2 (test pretrained model) * fix code style issues * LightningTestModel: add optional second test set, implement test_step and test_end * implemented test for multiple test_dataloaders; fixed typo * add two test cases for #89 * add documentation for test_step, test_end; fix computation of loss in validation_step example * Update trainer.py * Update trainer.py * Update trainer.py * Update trainer.py * Update trainer.py * Update trainer.py * Added proper dp ddp routing calls for test mode * Update trainer.py * Update test_models.py * Update trainer.py * Update trainer.py * Update override_data_parallel.py * Update test_models.py * Update test_models.py * Update trainer.py * Update trainer.py * Update trainer.py * Update test_models.py * Update test_models.py * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * debug * Update trainer.py * Update override_data_parallel.py * Update debug.py * Update lm_test_module.py * Update test_models.py	2019-09-02 07:15:27 -04:00
Stanislav	73cf47112e	Gradient accumulation callback (#150) ... * Gradient accumulation callback * little test case * typo * import fix * method name fix * fix epochs indexing from 1 * better code style * code style fix v2 :/ * change interface * fix Trainre new api in tests * trainer api bug fix * new raising error, new update method * extentions tests * a little better tests * typo fix * flack8 better * using scheduler for int and dict * typo * firs epoch bug fix * test update * empty dict exception * floats check * codestyle fix * grad counting test * someday, i will install normal linter * add more checks * Update test_models.py * Update test_models.py * Update test_models.py * Update test_models.py * Update test_models.py * Update test_models.py * Update test_models.py	2019-08-30 10:56:14 -04:00
William Falcon	4104a0fc47	cleaned up progbar (#165) ... * cleaned up progbar * cleaned up progbar * cleaned up progbar * cleaned up progbar * cleaned up progbar * cleaned up progbar * cleaned up progbar * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * updated base files * flake 8	2019-08-23 21:23:27 -04:00
eqs	4a0b56755c	bug fix for #157 (#158) ... * Separate condition list/tuple case into separated cases * Add test for tuple of tensor list and list of tensor dict * Update test_models.py	2019-08-21 10:22:51 -04:00
William Falcon	a27fb5d54c	enhanced optimizer return options (#120) ... * added smarter optimizer options * added smarter optimizer options * added smarter optimizer options tests * added smarter optimizer options tests * added smarter optimizer options tests * added smarter optimizer options tests * added smarter optimizer options tests * added smarter optimizer options tests * added smarter optimizer options tests * added single gpu data transfer recursive * added single gpu data transfer recursive * added single gpu data transfer recursive * added single gpu data transfer recursive * added single gpu data transfer recursive	2019-08-15 11:31:56 -04:00
William Falcon	db9254acbe	enable recursive parsing for single gpu inputs (#121) ... * added tests * added single gpu data transfer recursive * added single gpu data transfer recursive * added single gpu data transfer recursive * added single gpu data transfer recursive * added single gpu data transfer recursive * added single gpu data transfer recursive	2019-08-15 09:39:09 -04:00
William Falcon	7f53e7bfb3	Val idx optional in validation_step (#108) ... * made dataset_i only available with multiple datasets * updated interface signature * updated tests	2019-08-13 11:37:37 -04:00