mirror of
https://github.com/wassname/ray.git
synced 2026-06-28 10:33:16 +08:00
Richard Liaw
037aa2b961
* Refactor documentation and directory structurre * update loss * ,ore examples * fix comments * more code * svgs * formatting * more_docs * more writing * comments ready * move * whitespace * examples * fix * bold * pytorch * batch * fix * fix test * Apply suggestions from code review * quarantinegp * tests/ * fix missing
39 lines
1.1 KiB
ReStructuredText
39 lines
1.1 KiB
ReStructuredText
.. _raysgd-pytorch-example:
|
|
|
|
RaySGD PyTorch Examples
|
|
=======================
|
|
|
|
Here are some examples of using RaySGD for training PyTorch models. If you'd like
|
|
to contribute an example, feel free to create a `pull request here <https://github.com/ray-project/ray/pull/>`_.
|
|
|
|
|
|
Toy Example
|
|
-----------
|
|
|
|
Below is an example of using Ray's PyTorchTrainer.
|
|
|
|
|
|
.. literalinclude:: ../../../python/ray/experimental/sgd/pytorch/examples/train_example.py
|
|
:language: python
|
|
:start-after: __torch_train_example__
|
|
|
|
|
|
CIFAR10 Example
|
|
---------------
|
|
|
|
Below is an example of training a ResNet18 model on CIFAR10. It uses a custom training
|
|
function, a custom validation function, and custom initialization code for each worker.
|
|
|
|
.. literalinclude:: ../../../python/ray/experimental/sgd/pytorch/examples/cifar_pytorch_example.py
|
|
:language: python
|
|
|
|
|
|
DCGAN Example
|
|
-------------
|
|
|
|
Below is an example of training a Deep Convolutional GAN on MNIST. It constructs
|
|
two models and two optimizers and uses a custom training and validation function.
|
|
|
|
.. literalinclude:: ../../../python/ray/experimental/sgd/pytorch/examples/dcgan.py
|
|
:language: python
|