William Falcon
55e7322747
Metrics load ( #228 )
...
* load from metrics defaults to CPU
* load from metrics defaults to CPU
* load from metrics defaults to CPU
2019-09-16 10:47:19 -04:00
William Falcon
9576dd28b2
added load on CPU first ( #221 )
...
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added load on CPU first
* added print logs
* added print logs
* changed close order
* changed close order
2019-09-11 07:52:36 -04:00
William Falcon
506d5da68b
enable single gpu per node ( #218 )
...
* enable single gpu per node
* enable single gpu per node
* enable single gpu per node
* enable single gpu per node
* enable single gpu per node
* enable single gpu per node
2019-09-09 07:37:20 -04:00
William Falcon
10d190e045
Simplified gpu api. No NVIDIA flag managing by lightning for cluster ( #213 )
...
* added nvidia flag set
* added nvidia flag set
* added nvidia flag set
* added nvidia flag set
* added nvidia flag set
* added nvidia flag set
* added nvidia flag set
* added nvidia flag set
* added simple cluster template
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
* sets correct backend for possible combinations of gpu inputs
2019-09-08 15:36:58 -04:00
William Falcon
7099f8dbfb
split trainer mixins ( #209 )
...
* split trainer mixins
* Update multi_node_cluster_template.py
* Update single_cpu_template.py
* Update single_gpu_node_16bit_template.py
* Update single_gpu_node_ddp_template.py
* Update single_gpu_node_dp_template.py
* Update trainer_cpu_template.py
* Update trainer_io.py
* split trainer mixins
* Update multi_node_cluster_template.py
* deconflicted
* deconflicted
* deconflicted
2019-09-06 14:11:07 -04:00
William Falcon
60633eaa32
Moves hpc auto-resubmit to trainer from test-tube ( #207 )
...
* added slurm signal handler
* added restore weight functions
* set slurm signal handling inside process
* added resubmit docs
* added resubmit docs
* fixed missing param
* Update trainer.py
* fixed missing param
* fixed missing param
* debugging tests
* debugging tests
* debugging tests
* debugging tests
* debugging tests
* debugging tests
* debugging tests
2019-09-06 11:54:51 -04:00
Nic Eggert
1733dba735
Pass outputs from all dataloaders to test_end and validation_end ( #203 )
...
* Pass outputs from all dataloaders to test_end and validation_end
* Update tests
* Update docs
* Update trainer.py
* Update test_models.py
2019-09-06 07:37:25 -04:00
Nic Eggert
64688e1e15
Refactor test modules ( #180 )
...
* Expectopatronum implement #89 (#182 )
* rename validate -> evaluate; implement test logic; allow multiple test_loaders
* add test_step and test_end to LightningModule
* add in_test_mode to pretraining to implement case 2 (test pretrained model)
* fix code style issues
* LightningTestModel: add optional second test set, implement test_step and test_end
* implemented test for multiple test_dataloaders; fixed typo
* add two test cases for #89
* add documentation for test_step, test_end; fix computation of loss in validation_step example
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Added proper dp ddp routing calls for test mode
* Update trainer.py
* Update test_models.py
* Update trainer.py
* Update trainer.py
* Update override_data_parallel.py
* Update test_models.py
* Update test_models.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update test_models.py
* Update test_models.py
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* Update trainer.py
* Update override_data_parallel.py
* Update debug.py
* Update lm_test_module.py
* Update test_models.py
* release v0.4.8
* Update README.md
* add training loop docs
* testing loop docs
* testing loop docs
* Convert __dataloader to _dataloader
This will let inherited classes use it
* Factor common test model setup into base class
* Specialized test modules inherit from LightningTestModelBase
* Fix __is_overriden so that it works with more complicated inheritance
* Use mixins to add functionality to test models
* Fix test with no val_dataloader
* Remove unused imports
* Get rid of wild card import
* Update trainer.py
* Update lm_test_module.py
2019-09-02 15:46:16 -04:00
Verena Haunschmid
25d5b25792
Expectopatronum implement #89 ( #182 )
...
* rename validate -> evaluate; implement test logic; allow multiple test_loaders
* add test_step and test_end to LightningModule
* add in_test_mode to pretraining to implement case 2 (test pretrained model)
* fix code style issues
* LightningTestModel: add optional second test set, implement test_step and test_end
* implemented test for multiple test_dataloaders; fixed typo
* add two test cases for #89
* add documentation for test_step, test_end; fix computation of loss in validation_step example
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Added proper dp ddp routing calls for test mode
* Update trainer.py
* Update test_models.py
* Update trainer.py
* Update trainer.py
* Update override_data_parallel.py
* Update test_models.py
* Update test_models.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update test_models.py
* Update test_models.py
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* Update trainer.py
* Update override_data_parallel.py
* Update debug.py
* Update lm_test_module.py
* Update test_models.py
2019-09-02 07:15:27 -04:00
Stanislav
73cf47112e
Gradient accumulation callback ( #150 )
...
* Gradient accumulation callback
* little test case
* typo
* import fix
* method name fix
* fix epochs indexing from 1
* better code style
* code style fix v2 :/
* change interface
* fix Trainre new api in tests
* trainer api bug fix
* new raising error, new update method
* extentions tests
* a little better tests
* typo fix
* flack8 better
* using scheduler for int and dict
* typo
* firs epoch bug fix
* test update
* empty dict exception
* floats check
* codestyle fix
* grad counting test
* someday, i will install normal linter
* add more checks
* Update test_models.py
* Update test_models.py
* Update test_models.py
* Update test_models.py
* Update test_models.py
* Update test_models.py
* Update test_models.py
2019-08-30 10:56:14 -04:00
William Falcon
4104a0fc47
cleaned up progbar ( #165 )
...
* cleaned up progbar
* cleaned up progbar
* cleaned up progbar
* cleaned up progbar
* cleaned up progbar
* cleaned up progbar
* cleaned up progbar
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* flake 8
2019-08-23 21:23:27 -04:00
eqs
4a0b56755c
bug fix for #157 ( #158 )
...
* Separate condition list/tuple case into separated cases
* Add test for tuple of tensor list and list of tensor dict
* Update test_models.py
2019-08-21 10:22:51 -04:00
William Falcon
a27fb5d54c
enhanced optimizer return options ( #120 )
...
* added smarter optimizer options
* added smarter optimizer options
* added smarter optimizer options tests
* added smarter optimizer options tests
* added smarter optimizer options tests
* added smarter optimizer options tests
* added smarter optimizer options tests
* added smarter optimizer options tests
* added smarter optimizer options tests
* added single gpu data transfer recursive
* added single gpu data transfer recursive
* added single gpu data transfer recursive
* added single gpu data transfer recursive
* added single gpu data transfer recursive
2019-08-15 11:31:56 -04:00
William Falcon
db9254acbe
enable recursive parsing for single gpu inputs ( #121 )
...
* added tests
* added single gpu data transfer recursive
* added single gpu data transfer recursive
* added single gpu data transfer recursive
* added single gpu data transfer recursive
* added single gpu data transfer recursive
* added single gpu data transfer recursive
2019-08-15 09:39:09 -04:00
William Falcon
7f53e7bfb3
Val idx optional in validation_step ( #108 )
...
* made dataset_i only available with multiple datasets
* updated interface signature
* updated tests
2019-08-13 11:37:37 -04:00
Sidhanth Holalkere
511f7ecb9a
Support for multiple val_dataloaders ( #97 )
...
* Added support for multiple validation dataloaders
* Fix typo in README.md
* Update trainer.py
* Add support for multiple dataloaders
* Rename dataloader_index to dataloader_i
* Added warning to check val_dataloaders
Added a warning to ensure that all val_dataloaders were DistributedSamplers if ddp is enabled
* Updated DistributedSampler warning
* Fixed typo
* Added multiple val_dataloaders
* Multiple val_dataloader test
* Update lightning_module_template.py
Added dataloader_i to validation_step parameters
* Update trainer.py
* Reverted template changes
* Create multi_val_module.py
* Update no_val_end_module.py
* New MultiValModel
* Rename MultiValModel to MultiValTestModel
* Revert to LightningTestModel
* Update test_models.py
* Update trainer.py
* Update test_models.py
* multiple val_dataloaders in test template
* Fixed flake8 warnings
* Update trainer.py
* Fix flake errors
* Fixed Flake8 errors
* Update lm_test_module.py
keep this test model with a single dataset for val
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update test_models.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update RequiredTrainerInterface.md
* Update RequiredTrainerInterface.md
* Update test_models.py
* Update trainer.py
dont need the else clause, val_dataloader is either a list or none because of get_dataloaders()
* Update trainer.py
fixed flake errors
* Update trainer.py
2019-08-12 15:23:11 -04:00
William Falcon
e5805bf8ff
val and test are optional now ( #95 )
...
* made validation step optional
* added no val model
* val_step can be implemented but not validation_end
* added no val end model
* added tests
* added tests
* remove class
* remove class
* remove class
* remove class
* remove class
* remove class
* remove class
* remove class
* remove class
* remove class
* remove class
* updated docs
* updated docs
* updated test
* updated test
* updated test
* updated test
* updated test
* updated test
* updated test
* updated test
* updated test
* fix pep8
2019-08-11 10:01:57 -04:00
Nic Eggert
996b1f9a6d
When running DDP without DistributedSampler, throw warning instead of exception ( #91 )
2019-08-10 15:58:12 -04:00
William Falcon
3d23a56ed2
make experiment param in trainer optional ( #77 )
...
* removed forced exp
* modified test to also run without exp
2019-08-08 10:59:16 -04:00
William Falcon
aa7245d9db
Load fix ( #74 )
...
* skip weight load without callback
* added simple cpu test
* fixed pep
2019-08-08 06:00:04 -04:00
William Falcon
c7e8436083
added single gpu train test
2019-08-07 13:40:51 -04:00
William Falcon
16e5093805
added test model to do also
2019-08-07 11:47:05 -04:00
williamFalcon
8a58c6f8f0
added badge
2019-08-07 08:02:03 -07:00
williamFalcon
f32b9064ac
added badge
2019-08-07 08:01:33 -07:00
William Falcon
a2d6d514d5
cleaned up pep8 issues
2019-08-07 10:19:03 -04:00
William Falcon
549d0f66df
Merge pull request #52 from alok/ptl-pl
...
Rename `ptl` to `pl`
2019-08-07 09:09:15 -04:00
William Falcon
35f23bbc82
Merge pull request #55 from williamFalcon/continue
...
add training restore
2019-08-07 09:02:16 -04:00
Jiri BOROVEC
86a90bfefd
update codecov
2019-08-07 14:32:32 +02:00
William Falcon
0b92fe6cea
updated test
2019-08-07 08:07:59 -04:00
William Falcon
0527a1dad1
debug
2019-08-07 08:03:40 -04:00
William Falcon
2018380598
debug
2019-08-07 08:01:42 -04:00
William Falcon
1e17bf76aa
debug
2019-08-07 08:01:33 -04:00
William Falcon
cdbcbad352
added hook on_sanity_check_start
2019-08-07 07:51:55 -04:00
William Falcon
8e4fe2002b
fixed restore location
2019-08-07 07:45:57 -04:00
William Falcon
9713c41bf4
removed bad hook call
2019-08-07 07:33:08 -04:00
William Falcon
2575b157a4
removed bad hook call
2019-08-07 07:32:33 -04:00
William Falcon
47a691f158
updated tests and docs
2019-08-07 07:09:37 -04:00
Alok Singh
8b9f021ee6
Rename ptl to pl
...
Closes #46 .
2019-08-06 23:02:55 -07:00
Jiri BOROVEC
d9bfe964f9
update by flake8
2019-08-06 22:45:46 +02:00
Jiri BOROVEC
4e0b9c50e7
add CircleCI
2019-08-06 22:45:46 +02:00
Jiri BOROVEC
632d07b490
fix prints for py3.5
2019-08-06 22:45:46 +02:00
Jiri BOROVEC
c44966a8bf
apply PEP8
2019-08-06 22:45:27 +02:00
Jiri BOROVEC
50cca25d6f
add missing req.
2019-08-06 22:45:27 +02:00
Jiri BOROVEC
627ac0be32
fix tests req.
2019-08-06 22:44:13 +02:00
William Falcon
a79de1ec8e
Update README.md
2019-08-06 06:57:31 -04:00
Jiri BOROVEC
469941a528
pkg relative imports
...
* split requirements.txt
* pytest verbose
2019-08-05 10:52:09 +02:00
Jiri BOROVEC
92f8c57ff5
cutout examples
2019-08-05 09:51:47 +02:00
William Falcon
598e1accb5
updated docs
2019-08-01 10:11:26 -04:00
williamFalcon
b9e0d841dc
fixed lr scheduler tests
2019-07-28 06:21:41 -07:00
William Falcon
587c195298
added clean slurm save load test
2019-07-26 23:04:41 -04:00
William Falcon