Ashwin Bharambe aefc5314bc [ddp] Support multi-node distributed execution under torchelastic (#1811) ...

The changes are quite local and limited in nature -- viz., checking for
some indicator environment variables. We check for (SLURM_LOCALID,
NODE_RANK, GROUP_RANK) in order. If multiple are found set, a warning is
logged.

This patch also fixes a minor bug with comparing the `WORLD_SIZE`
environment variable. This can be a string type.

2020-05-13 14:06:59 -04:00

..

__init__.py

Option to provide seed to random generators to ensure reproducibility (#1572)

2020-05-12 07:53:20 -04:00

auto_mix_precision.py

support for native amp (#1561)

2020-04-23 14:47:08 -04:00

callback_config.py

Fix typo (#1750)

2020-05-07 09:25:54 -04:00

callback_hook.py

Progress bar callback (#1450)

2020-04-23 20:46:18 -04:00

data_loading.py

added warning for None dataloader (#1745)

2020-05-07 09:26:41 -04:00

deprecated_api.py

Progress bar callback (#1450)

2020-04-23 20:46:18 -04:00

distrib_data_parallel.py

[ddp] Support multi-node distributed execution under torchelastic (#1811)

2020-05-13 14:06:59 -04:00

distrib_parts.py

device property (#1791)

2020-05-12 23:18:39 -04:00

evaluation_loop.py

Replace meta_tags.csv with hparams.yaml (#1271)

2020-05-13 15:05:15 +02:00

ignored_warnings.py

Dim 0 warning (#256)

2019-09-26 13:20:54 -04:00

logging.py

[WIP] Reduction when batch size < num gpus (#1609)

2020-05-02 11:01:44 -04:00

lr_finder.py

Feature: auto scale batch size (#1638)

2020-05-09 08:28:36 -04:00

model_hooks.py

Fix typo (#1750)

2020-05-07 09:25:54 -04:00

optimizers.py

dataloaders with fast_dev_run (#1787)

2020-05-11 23:32:44 -04:00

seed.py

Option to provide seed to random generators to ensure reproducibility (#1572)

2020-05-12 07:53:20 -04:00

supporters.py

Fixed configure optimizer from dict without "scheduler" key (#1443)

2020-04-10 11:43:06 -04:00

trainer.py

[ddp] Support multi-node distributed execution under torchelastic (#1811)

2020-05-13 14:06:59 -04:00

training_io.py

Replace meta_tags.csv with hparams.yaml (#1271)

2020-05-13 15:05:15 +02:00

training_loop.py

Also update progress_bar in training_epoch_end (#1724)

2020-05-08 23:31:56 -04:00

training_tricks.py

dataloaders with fast_dev_run (#1787)

2020-05-11 23:32:44 -04:00