wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-09-10 12:38:43 +08:00
Code Issues Packages Projects Releases Wiki Activity

[rllib] Allow access to batches prior to postprocessing (#4871)

Browse Source
This commit is contained in:
Eric Liang
2019-05-29 18:17:14 -07:00
committed by GitHub
parent a218a14c92
commit 2dd0beb5bd
5 changed files with 24 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
doc/source/rllib-algorithms.rst
+4
View File
@@ -101,6 +101,10 @@ Tuned examples: `PongNoFrameskip-v4 <https://github.com/ray-project/ray/blob/mas
**APPO-specific configs** (see also `common configs <rllib-training.html#common-parameters>`__):
.. warning::
Keras custom models are not compatible with multi-GPU (this includes PPO in single-GPU mode). This is because the multi-GPU implementation in RLlib relies on variable scopes to implement cross-GPU support.
.. literalinclude:: ../../python/ray/rllib/agents/ppo/appo.py
:language: python
:start-after: __sphinx_doc_begin__