Roshan RaoandWilliam Falcon 0203938af8 Update learning rate on each backward pass instead of each forward pass. (#1477) ...

* change lr scheduler step interval to update every backwards pass instead of every forwards pass

* update CHANGELOG

* fix spacing

* Add TODO to lr schedule update

* remove trailing whitespace

Co-authored-by: William Falcon <waf2107@columbia.edu>

2020-04-20 08:03:52 -04:00

..

__init__.py

Add ddp_cpu backend for testing ddp without GPUs (#1158)

2020-04-15 23:17:31 -04:00

auto_mix_precision.py

Set precision=16 when use_amp is passed as True (#1145)

2020-04-06 08:13:24 -04:00

callback_config.py

Fix weights path (#1445)

2020-04-10 12:02:59 -04:00

callback_hook.py

cleaning imports (#1032)

2020-03-12 12:41:37 -04:00

data_loading.py

DDP sampler (#1513)

2020-04-19 16:58:57 -04:00

deprecated_api.py

fix deprecated default_save_path (#1449)

2020-04-10 14:32:56 -04:00

distrib_data_parallel.py

Add SLURM check in ddp_train() and init_ddp_connection() (#1387)

2020-04-19 17:08:19 -04:00

distrib_parts.py

Allow Trainer's gpus arg type to be subclass of currently accepted types (#1423)

2020-04-17 18:18:29 -04:00

evaluation_loop.py

fixed memory leak from opt return (#1528)

2020-04-19 16:41:54 -04:00

ignored_warnings.py

Dim 0 warning (#256)

2019-09-26 13:20:54 -04:00

logging.py

fixed memory leak from opt return (#1528)

2020-04-19 16:41:54 -04:00

lr_finder.py

Learning Rate finder (#1347)

2020-04-10 14:34:23 -04:00

model_hooks.py

Remove error when test dataloader used in test (#1495)

2020-04-15 22:16:40 -04:00

optimizers.py

Fixed configure optimizer from dict without "scheduler" key (#1443)

2020-04-10 11:43:06 -04:00

supporters.py

Fixed configure optimizer from dict without "scheduler" key (#1443)

2020-04-10 11:43:06 -04:00

trainer.py

Fix callback default (horror bug!) (#1534)

2020-04-20 07:02:53 -04:00

training_io.py

Fix weights path (#1445)

2020-04-10 12:02:59 -04:00

training_loop.py

Update learning rate on each backward pass instead of each forward pass. (#1477)

2020-04-20 08:03:52 -04:00

training_tricks.py

Removed redundant computations in clip_gradients that slowed down the gradient clipping. (#1523)

2020-04-18 23:07:15 -04:00