mirror of
https://github.com/wassname/pytorch-lightning.git
synced 2026-08-31 12:21:29 +08:00
* added outline of all features * updated common use cases doc * updated common use cases doc * updated common use cases doc * updated common use cases doc * updated common use cases doc * updated common use cases doc * updated common use cases doc * updated common use cases doc * updated common use cases doc * updated common use cases doc * updated common use cases doc * updated common use cases doc * updated common use cases doc * updated docs
53 lines
938 B
ReStructuredText
53 lines
938 B
ReStructuredText
Hooks
|
|
=======
|
|
This is the order in which lightning calls the hooks. You can override each for custom behavior.
|
|
|
|
Training set-up
|
|
--------------------
|
|
- init_ddp_connection
|
|
- init_optimizers
|
|
- configure_apex
|
|
- configure_ddp
|
|
- get_train_dataloader
|
|
- get_test_dataloaders
|
|
- get_val_dataloaders
|
|
- summarize
|
|
- restore_weights
|
|
|
|
Training loop
|
|
--------------------
|
|
|
|
- on_epoch_start
|
|
- on_batch_start
|
|
- tbptt_split_batch
|
|
- training_step
|
|
- training_end (optional)
|
|
- backward
|
|
- on_after_backward
|
|
- optimizer.step()
|
|
- on_batch_end
|
|
- on_epoch_end
|
|
|
|
Validation loop
|
|
--------------------
|
|
|
|
- model.zero_grad()
|
|
- model.eval()
|
|
- torch.set_grad_enabled(False)
|
|
- validation_step
|
|
- validation_end
|
|
- model.train()
|
|
- torch.set_grad_enabled(True)
|
|
- on_post_performance_check
|
|
|
|
Test loop
|
|
------------
|
|
|
|
- model.zero_grad()
|
|
- model.eval()
|
|
- torch.set_grad_enabled(False)
|
|
- test_step
|
|
- test_end
|
|
- model.train()
|
|
- torch.set_grad_enabled(True)
|
|
- on_post_performance_check |