added docs page

This commit is contained in:
William Falcon
2019-06-26 20:15:18 -04:00
parent 4a1c7feda0
commit 1de54e598e
+19 -7
View File
@@ -1,10 +1,10 @@
# PYTORCH-LIGHTNING DOCUMENTATION # PYTORCH-LIGHTNING DOCUMENTATION
###### Quick start ###### Quick start
- Model interface - Define a lightning model
- Trainer set up - Set up the trainer
###### Examples ###### Quick start examples
- CPU example - CPU example
- Single GPU example - Single GPU example
- Multi-gpu example - Multi-gpu example
@@ -20,10 +20,22 @@
- Model saving - Model saving
- Model loading - Model loading
###### Mixed precision training
- 16-bit mixed precision
###### Computing cluster (SLURM) ###### Computing cluster (SLURM)
- Automatic checkpointing - Automatic checkpointing
- Automatic saving, loading - Automatic saving, loading
- Walltime auto-resubmit - Walltime auto-resubmit
###### Common training use cases
- 16-bit mixed precision
- Accumulate gradients
- Check val many times during 1 training epoch
- Check GPU usage
- Check validation every n epochs
- Check which gradients are nan
- Inspect gradient norms
- Learning rate annealing
- Make model overfit on subset of data
- Min, max epochs
- Multiple optimizers (like GANs)
- Run a sanity check of model val and tng step
- Set how much of the tng, val, test sets to check (1-100%)