added docs page

This commit is contained in:
William Falcon
2019-06-26 20:15:18 -04:00
parent 4a1c7feda0
commit 1de54e598e
+19 -7
View File
@@ -1,10 +1,10 @@
# PYTORCH-LIGHTNING DOCUMENTATION
###### Quick start
- Model interface
- Trainer set up
- Define a lightning model
- Set up the trainer
###### Examples
###### Quick start examples
- CPU example
- Single GPU example
- Multi-gpu example
@@ -20,10 +20,22 @@
- Model saving
- Model loading
###### Mixed precision training
- 16-bit mixed precision
###### Computing cluster (SLURM)
- Automatic checkpointing
- Automatic saving, loading
- Walltime auto-resubmit
- Walltime auto-resubmit
###### Common training use cases
- 16-bit mixed precision
- Accumulate gradients
- Check val many times during 1 training epoch
- Check GPU usage
- Check validation every n epochs
- Check which gradients are nan
- Inspect gradient norms
- Learning rate annealing
- Make model overfit on subset of data
- Min, max epochs
- Multiple optimizers (like GANs)
- Run a sanity check of model val and tng step
- Set how much of the tng, val, test sets to check (1-100%)