4 people d0c9472cb3 Add SLURM check in ddp_train() and init_ddp_connection() (#1387) ...

* slurm check in ddp_train and init_ddp_connection

* Remove code example in init_ddp_connection

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* remove blank line

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* improve for test coverage

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* update changelog

* Default values and warnings for DDP env variables

* fix merge artifacts

* update localhost value

* change to NODE_RANK

Co-authored-by: Alexander Reshytko <areshytko@Alexanders-MacBook-Pro.local>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>

2020-04-19 17:08:19 -04:00

..

__init__.py

Add ddp_cpu backend for testing ddp without GPUs (#1158)

2020-04-15 23:17:31 -04:00

auto_mix_precision.py

Set precision=16 when use_amp is passed as True (#1145)

2020-04-06 08:13:24 -04:00

callback_config.py

Fix weights path (#1445)

2020-04-10 12:02:59 -04:00

callback_hook.py

cleaning imports (#1032)

2020-03-12 12:41:37 -04:00

data_loading.py

DDP sampler (#1513)

2020-04-19 16:58:57 -04:00

deprecated_api.py

fix deprecated default_save_path (#1449)

2020-04-10 14:32:56 -04:00

distrib_data_parallel.py

Add SLURM check in ddp_train() and init_ddp_connection() (#1387)

2020-04-19 17:08:19 -04:00

distrib_parts.py

Allow Trainer's gpus arg type to be subclass of currently accepted types (#1423)

2020-04-17 18:18:29 -04:00

evaluation_loop.py

fixed memory leak from opt return (#1528)

2020-04-19 16:41:54 -04:00

ignored_warnings.py

Dim 0 warning (#256)

2019-09-26 13:20:54 -04:00

logging.py

fixed memory leak from opt return (#1528)

2020-04-19 16:41:54 -04:00

lr_finder.py

Learning Rate finder (#1347)

2020-04-10 14:34:23 -04:00

model_hooks.py

Remove error when test dataloader used in test (#1495)

2020-04-15 22:16:40 -04:00

optimizers.py

Fixed configure optimizer from dict without "scheduler" key (#1443)

2020-04-10 11:43:06 -04:00

supporters.py

Fixed configure optimizer from dict without "scheduler" key (#1443)

2020-04-10 11:43:06 -04:00

trainer.py

DDP sampler (#1513)

2020-04-19 16:58:57 -04:00

training_io.py

Fix weights path (#1445)

2020-04-10 12:02:59 -04:00

training_loop.py

fixed memory leak from opt return (#1528)

2020-04-19 16:41:54 -04:00

training_tricks.py

Removed redundant computations in clip_gradients that slowed down the gradient clipping. (#1523)

2020-04-18 23:07:15 -04:00