mirror of
https://github.com/wassname/pytorch-lightning.git
synced 2026-09-10 12:21:57 +08:00
added docs page
This commit is contained in:
+18
-6
@@ -1,10 +1,10 @@
|
|||||||
# PYTORCH-LIGHTNING DOCUMENTATION
|
# PYTORCH-LIGHTNING DOCUMENTATION
|
||||||
|
|
||||||
###### Quick start
|
###### Quick start
|
||||||
- Model interface
|
- Define a lightning model
|
||||||
- Trainer set up
|
- Set up the trainer
|
||||||
|
|
||||||
###### Examples
|
###### Quick start examples
|
||||||
- CPU example
|
- CPU example
|
||||||
- Single GPU example
|
- Single GPU example
|
||||||
- Multi-gpu example
|
- Multi-gpu example
|
||||||
@@ -20,10 +20,22 @@
|
|||||||
- Model saving
|
- Model saving
|
||||||
- Model loading
|
- Model loading
|
||||||
|
|
||||||
###### Mixed precision training
|
|
||||||
- 16-bit mixed precision
|
|
||||||
|
|
||||||
###### Computing cluster (SLURM)
|
###### Computing cluster (SLURM)
|
||||||
- Automatic checkpointing
|
- Automatic checkpointing
|
||||||
- Automatic saving, loading
|
- Automatic saving, loading
|
||||||
- Walltime auto-resubmit
|
- Walltime auto-resubmit
|
||||||
|
|
||||||
|
###### Common training use cases
|
||||||
|
- 16-bit mixed precision
|
||||||
|
- Accumulate gradients
|
||||||
|
- Check val many times during 1 training epoch
|
||||||
|
- Check GPU usage
|
||||||
|
- Check validation every n epochs
|
||||||
|
- Check which gradients are nan
|
||||||
|
- Inspect gradient norms
|
||||||
|
- Learning rate annealing
|
||||||
|
- Make model overfit on subset of data
|
||||||
|
- Min, max epochs
|
||||||
|
- Multiple optimizers (like GANs)
|
||||||
|
- Run a sanity check of model val and tng step
|
||||||
|
- Set how much of the tng, val, test sets to check (1-100%)
|
||||||
|
|||||||
Reference in New Issue
Block a user