Sven Mika 22ccc43670 [RLlib] DQN torch version. (#7597) ...

* Fix.

* Rollback.

* WIP.

* WIP.

* WIP.

* WIP.

* WIP.

* WIP.

* WIP.

* WIP.

* Fix.

* Fix.

* Fix.

* Fix.

* Fix.

* WIP.

* WIP.

* Fix.

* Test case fixes.

* Test case fixes and LINT.

* Test case fixes and LINT.

* Rollback.

* WIP.

* WIP.

* Test case fixes.

* Fix.

* Fix.

* Fix.

* Add regression test for DQN w/ param noise.

* Fixes and LINT.

* Fixes and LINT.

* Fixes and LINT.

* Fixes and LINT.

* Fixes and LINT.

* Comment

* Regression test case.

* WIP.

* WIP.

* LINT.

* LINT.

* WIP.

* Fix.

* Fix.

* Fix.

* LINT.

* Fix (SAC does currently not support eager).

* Fix.

* WIP.

* LINT.

* Update rllib/evaluation/sampler.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/evaluation/sampler.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/utils/exploration/exploration.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/utils/exploration/exploration.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* WIP.

* WIP.

* Fix.

* LINT.

* LINT.

* Fix and LINT.

* WIP.

* WIP.

* WIP.

* WIP.

* Fix.

* LINT.

* Fix.

* Fix and LINT.

* Update rllib/utils/exploration/exploration.py

* Update rllib/policy/dynamic_tf_policy.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/policy/dynamic_tf_policy.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/policy/dynamic_tf_policy.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Fixes.

* WIP.

* LINT.

* Fixes and LINT.

* LINT and fixes.

* LINT.

* Move action_dist back into torch extra_action_out_fn and LINT.

* Working SimpleQ learning cartpole on both torch AND tf.

* Working Rainbow learning cartpole on tf.

* Working Rainbow learning cartpole on tf.

* WIP.

* LINT.

* LINT.

* Update docs and add torch to APEX test.

* LINT.

* Fix.

* LINT.

* Fix.

* Fix.

* Fix and docstrings.

* Fix broken RLlib tests in master.

* Split BAZEL learning tests into cartpole and pendulum (reached the 60min barrier).

* Fix error_outputs option in BAZEL for RLlib regression tests.

* Fix.

* Tune param-noise tests.

* LINT.

* Fix.

* Fix.

* test

* test

* test

* Fix.

* Fix.

* WIP.

* WIP.

* WIP.

* WIP.

* LINT.

* WIP.

Co-authored-by: Eric Liang <ekhliang@gmail.com>

2020-04-06 11:56:16 -07:00

..

_static

Revert wide docs (#7782)

2020-03-27 17:46:08 -07:00

_templates

[docs] Add a feedback form (#5610)

2019-09-02 01:28:28 -07:00

images

[RLlib] Add Exploration API documentation. (#7373)

2020-03-01 16:55:41 -08:00

raysgd

[sgd] make ddp optional (#7875)

2020-04-06 11:41:36 -07:00

tune/api_docs

[tune] Reformat Sections of API Reference (#7706)

2020-03-23 12:23:21 -07:00

a2c-arch.svg

[rllib] [docs] Add some architecture diagrams (#5390)

2019-08-06 20:14:57 -07:00

actors.rst

Change actor.__ray_kill__() to ray.kill(actor) (#7360)

2020-02-28 11:55:13 -06:00

advanced.rst

Add ray.util package and move libraries from experimental (#7100)

2020-02-18 13:43:19 -08:00

apex-arch.svg

[rllib] [docs] Add some architecture diagrams (#5390)

2019-08-06 20:14:57 -07:00

apex.png

[rllib] Document "v2" APIs (#2316)

2018-07-01 00:05:08 -07:00

async_api.rst

Fix typo in asyncio documentation (#7602)

2020-03-17 10:37:37 -05:00

autoscaler-status.png

Update the pip wheel in example.yaml and add docs (#1381)

2018-01-01 13:02:05 -08:00

autoscaling.rst

[autoscaler] Switch to ARM for Azure deployment (#7717)

2020-04-03 15:51:56 -07:00

cluster-index.rst

Add ray.util package and move libraries from experimental (#7100)

2020-02-18 13:43:19 -08:00

conf.py

[docs] Fix readthedocs rendering (#7810)

2020-03-30 11:40:08 -07:00

configure.rst

[docs] Make walkthrough and starting Ray materials clear (#7099)

2020-02-11 23:17:30 -08:00

custom_directives.py

[docs] Pictures for all the Examples (#5859)

2019-10-14 14:18:52 -07:00

custom_metric.png

[rllib] Implement custom metrics (#3144)

2018-11-03 18:48:32 -07:00

ddppo-arch.svg

[rllib] Add Decentralized DDPPO trainer and documentation (#7088)

2020-02-10 15:28:27 -08:00

deploy-on-kubernetes.rst

Ray on YARN + Skein Documentation (#6119)

2019-11-14 15:06:05 -08:00

deploy-on-yarn.rst

[docs] yarn update (#6173)

2019-11-19 16:15:08 -08:00

deploying-on-slurm.rst

Set redis password in slurm deployment documentation. (#5747)

2019-09-21 15:33:15 -07:00

development.rst

[tune] Update API Reference Page (#7671)

2020-03-22 16:42:20 -07:00

dqn-arch.svg

[rllib] [docs] Add some architecture diagrams (#5390)

2019-08-06 20:14:57 -07:00

es.png

[rllib] Document "v2" APIs (#2316)

2018-07-01 00:05:08 -07:00

fault-tolerance.rst

Document fault tolerance behavior. (#6698)

2020-01-06 22:34:06 -08:00

getting-involved.rst

[doc] Update the test command in getting-involved. (#6347)

2019-12-07 11:03:52 -08:00

impala-arch.svg

[rllib] [docs] Add some architecture diagrams (#5390)

2019-08-06 20:14:57 -07:00

impala.png

[rllib] Update multi-gpu impala numbers (#3327)

2018-11-19 20:55:27 -08:00

index.rst

[tune] Reformat Sections of API Reference (#7706)

2020-03-23 12:23:21 -07:00

installation.rst

Add links to 3.8 nightly wheels to docs. (#7902)

2020-04-04 21:59:45 -07:00

iter.rst

[Parallel Iterators] Allow for operator chaining after repartition (#7268)

2020-03-04 14:42:52 -08:00

joblib.rst

Add ray.util package and move libraries from experimental (#7100)

2020-02-18 13:43:19 -08:00

memory-management.rst

[docs] Add documentation for reference counting and 'ray memory' (#7661)

2020-03-20 15:47:00 -05:00

multi-agent.svg

[rllib] Document "v2" APIs (#2316)

2018-07-01 00:05:08 -07:00

multi-flat.svg

[rllib] RLlib in 60 seconds documentation (#5430)

2019-08-12 17:39:02 -07:00

multiprocessing.rst

Add ray.util package and move libraries from experimental (#7100)

2020-02-18 13:43:19 -08:00

offline-q.png

[rllib] Basic infrastructure for off-policy estimation (IS, WIS) (#3941)

2019-02-13 16:25:05 -08:00

package-ref.rst

Remove ray.tasks() from API. (#7807)

2020-04-01 10:10:40 -05:00

pandas_on_ray.rst

Dataframe deprecation (#2353)

2018-07-06 00:16:22 -07:00

pbt.png

[tune] Improve PBT example (#4575)

2019-04-09 20:59:17 -07:00

ppo-arch.svg

[rllib] [docs] Add some architecture diagrams (#5390)

2019-08-06 20:14:57 -07:00

ppo.png

[rllib] Document "v2" APIs (#2316)

2018-07-01 00:05:08 -07:00

profiling.rst

Release 0.8.0 test logs (#6512)

2019-12-17 15:56:50 -08:00

projects.rst

[Projects] Add small tutorial for projects (#6641)

2020-01-20 09:33:41 -08:00

pytorch.png

[rllib] Add TF and Torch icons to show which are available for each algo (#6869)

2020-01-20 15:22:21 -08:00

ray-dashboard.rst

Fix wording in dashboard documentation. (#7703)

2020-03-22 22:16:40 -07:00

ray-tune-parcoords.png

[tune] Fix Docs (#1469)

2018-01-25 16:39:00 -08:00

ray-tune-tensorboard.png

[tune] Documentation for Ray.tune (#1243)

2017-11-23 11:31:59 -08:00

ray-tune-viskit.png

[tune] Documentation for Ray.tune (#1243)

2017-11-23 11:31:59 -08:00

rllib-algorithms.rst

[RLlib] DQN torch version. (#7597)

2020-04-06 11:56:16 -07:00

rllib-api.svg

[rllib] Add rock paper scissors multi-agent example (#5336)

2019-08-01 13:03:59 -07:00

rllib-components.svg

[rllib] Adds eager support with a generic TFEagerPolicy class (#5436)

2019-08-23 14:21:11 +08:00

rllib-concepts.rst

#7246 - Fixing broken links (#7247)

2020-03-25 21:46:13 -07:00

rllib-config.svg

[rllib] Rename sample_batch_size => rollout_fragment_length (#7503)

2020-03-14 12:05:04 -07:00

rllib-dev.rst

[rllib] Fix shared metrics context in parallel iterators (#7666)

2020-03-22 14:15:01 -07:00

rllib-env.rst

[rllib] Add scaling guide to documentation, improve bandit docs (#7780)

2020-03-27 22:05:43 -07:00

rllib-envs.svg

[rllib] annotate public vs developer vs private APIs (#3808)

2019-01-23 21:27:26 -08:00

rllib-examples.rst

#7246 - Fixing broken links (#7247)

2020-03-25 21:46:13 -07:00

rllib-external.svg

[rllib] Add high-performance external application connector (#7641)

2020-03-20 12:43:57 -07:00

rllib-models.rst

[rllib] Support parallel, parameterized evaluation (#6981)

2020-02-01 22:12:12 -08:00

rllib-offline.rst

[RLlib] DDPG refactor and Exploration API action noise classes. (#7314)

2020-03-01 11:53:35 -08:00

rllib-package-ref.rst

[rllib] Port remainder of algorithms to build_trainer() pattern (#4920)

2019-06-07 16:45:36 -07:00

rllib-stack.svg

[rllib] Sync filters at end of iteration not start; hierarchical docs (#3769)

2019-01-15 16:25:25 -08:00

rllib-toc.rst

[rllib] Add scaling guide to documentation, improve bandit docs (#7780)

2020-03-27 22:05:43 -07:00

rllib-training.rst

[rllib] Add scaling guide to documentation, improve bandit docs (#7780)

2020-03-27 22:05:43 -07:00

rllib.rst

[docs] Make Ray slack more prominent (#7870)

2020-04-02 11:14:02 -07:00

rock-paper-scissors.png

[rllib] Add rock paper scissors multi-agent example (#5336)

2019-08-01 13:03:59 -07:00

serialization.rst

Removing unused Pyarrow Info (#7207)

2020-02-21 17:07:26 -08:00

serve.rst

Add ray.util package and move libraries from experimental (#7100)

2020-02-18 13:43:19 -08:00

sgd.png

[sgd] Document and add simple MNIST example (#3236)

2018-11-10 21:52:20 -08:00

starting-ray.rst

[docs] Make walkthrough and starting Ray materials clear (#7099)

2020-02-11 23:17:30 -08:00

tensorflow.png

[rllib] Add TF and Torch icons to show which are available for each algo (#6869)

2020-01-20 15:22:21 -08:00

throughput.png

[rllib] Document "v2" APIs (#2316)

2018-07-01 00:05:08 -07:00

timeline.png

[minor] Use a better timeline pic in the documentation

2017-12-20 12:54:25 -08:00

troubleshooting.rst

Consolidate and clean up documentation (#5645)

2019-09-07 11:50:18 -07:00

tune-advanced-tutorial.rst

[tune] demo exporting trained models in pbt examples (#6533)

2019-12-26 02:14:49 +01:00

tune-contrib.rst

[tune] Update API Reference Page (#7671)

2020-03-22 16:42:20 -07:00

tune-distributed.rst

[docs] Make walkthrough and starting Ray materials clear (#7099)

2020-02-11 23:17:30 -08:00

tune-examples.rst

[tune] tf2.0 mnist example (#5898)

2019-10-15 22:25:01 -07:00

tune-schedulers.rst

Fixed few broken links in docs (#5477)

2019-08-19 14:22:25 -07:00

tune-searchalg.rst

#7246 - Fixing broken links (#7247)

2020-03-25 21:46:13 -07:00

tune-tutorial.rst

[docs] Edit survey links (#6777)

2020-01-17 11:52:04 -08:00

tune-usage.rst

[tune] Reformat Sections of API Reference (#7706)

2020-03-23 12:23:21 -07:00

tune.rst

[docs] Make Ray slack more prominent (#7870)

2020-04-02 11:14:02 -07:00

using-ray-on-a-cluster.rst

[autoscaler] Adding Azure Support (#7080)

2020-03-15 14:48:27 -07:00

using-ray-with-gpus.rst

Consolidate and clean up documentation (#5645)

2019-09-07 11:50:18 -07:00

using-ray-with-pytorch.rst

[docs] Second push of changes (#5391)

2019-08-28 17:54:15 -07:00

using-ray-with-tensorflow.rst

[docs] fix code block display (#5967)

2019-10-22 00:45:38 -07:00

using-ray.rst

Add ray.util package and move libraries from experimental (#7100)

2020-02-18 13:43:19 -08:00

walkthrough.rst

Mention that calling some_function.remote() is non-blocking (#7417)

2020-03-04 13:35:46 -08:00