Commit Graph
4341 Commits
Author SHA1 Message Date
Sven MikaandGitHub 1d4823c0ec [RLlib] Add testing framework_iterator. (#7852)
* Add testing framework_iterator.

* LINT.

* WIP.

* Fix and LINT.

* LINT fix.
2020-04-03 12:24:25 -07:00
Sven MikaandGitHub bb6c675231 [RLlib] Bug fix: Copy is_exploring placeholder for multi-GPU tower generation. (#7846) 2020-04-03 10:44:58 -07:00
Sven MikaandGitHub 5537fe13b0 [RLlib] Exploration API: ParamNoise Integration into DQN; working example/test cases. (#7814) 2020-04-03 10:44:25 -07:00
Qing WangandGitHub 1b477c6dd0 [Streaming] Fix streaming CI failure. (#7869) 2020-04-03 10:45:25 +08:00
SangBin ChoandGitHub 1d532d1cb8 [Dashboard ]Action Implementation. (#7826) 2020-04-02 18:02:37 -07:00
Simon MoandGitHub a3181816b3 Add result from 0.8.4 release (#7876) 2020-04-02 15:31:03 -07:00
Edward OakesandGitHub 7f9ddfcfd8 Only access route_table and policy_table in master actor (#7835) 2020-04-02 14:44:53 -07:00
Edward OakesandGitHub cbe494ab13 [flaky test] Fix flaky test_heartbeats_single (#7857) 2020-04-02 16:23:28 -05:00
Richard LiawandGitHub 314250d072 [docs] Make Ray slack more prominent (#7870) 2020-04-02 11:14:02 -07:00
Sven MikaandGitHub 7b08db9f8c [RLlib] Remove all instances of tf.contrib.layers. ... from RLlib code (deprecated). (#7851) 2020-04-01 18:03:14 -07:00
ijrsvtandGitHub 9bfc2c4b54 Moving Local Mode to C++ (#7670) 2020-04-01 15:50:57 -05:00
mehrdadnandGitHub 65054a2c7c Python 3.8 compatibility (#7754) 2020-04-01 10:03:23 -07:00
Richard LiawandGitHub 24bf6ad607 [raysgd] Improve raysgd examples (#7818)
* better_example

* test

* improve some usability things

* submit

* fix

* flake

* Update python/ray/util/sgd/torch/training_operator.py

* trythis

* fix

* fix

* smoke

* fail

* fix

* fix
2020-04-01 08:58:39 -07:00
Edward OakesandGitHub f4239d27fa [serve] Create all other actors in master actor (#7791) 2020-04-01 10:15:04 -05:00
Robert NishiharaandGitHub b011c604d7 Remove ray.tasks() from API. (#7807) 2020-04-01 10:10:40 -05:00
micafanandGitHub 780c1c3b08 [GCS] impl RedisStoreClient for GCS Service (#7675) 2020-04-01 21:18:19 +08:00
e153e3179f [RLlib] Exploration API: Policy changes needed for forward pass noisifications. (#7798)
* Rollback.

* WIP.

* WIP.

* LINT.

* WIP.

* Fix.

* Fix.

* Fix.

* LINT.

* Fix (SAC does currently not support eager).

* Fix.

* WIP.

* LINT.

* Update rllib/evaluation/sampler.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/evaluation/sampler.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/utils/exploration/exploration.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/utils/exploration/exploration.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* WIP.

* WIP.

* Fix.

* LINT.

* LINT.

* Fix and LINT.

* WIP.

* WIP.

* WIP.

* WIP.

* Fix.

* LINT.

* Fix.

* Fix and LINT.

* Update rllib/utils/exploration/exploration.py

* Update rllib/policy/dynamic_tf_policy.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/policy/dynamic_tf_policy.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/policy/dynamic_tf_policy.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Fixes.

* LINT.

* WIP.

Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-04-01 00:43:21 -07:00
Sven MikaandGitHub 66df8b8c35 [RLlib] Working/learning example: PPO + torch + LSTM. (#7797) 2020-03-31 22:00:28 -07:00
SangBin ChoandGitHub c23e56ce9a Metrics Export Service (#7809) 2020-03-30 23:28:32 -07:00
bfb9248532 fix gcs server resolver error (#7822)
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-03-30 22:57:55 -07:00
mehrdadnandGitHub 8958728139 Windows bug fixes (#7740) 2020-03-30 20:39:23 -05:00
Simon MoandGitHub dc9b62e007 Deserialize Args in Event Loop Thread (#7806) 2020-03-30 18:28:13 -07:00
mehrdadnandGitHub f86e623095 Fix & improve GitHub Actions CI builds (#7784) 2020-03-30 16:29:54 -07:00
Sven MikaandGitHub e356e97eb2 [RLlib] Assert correct policy class being used in Worker. (#7769) 2020-03-30 14:03:29 -07:00
Richard LiawandGitHub fbf02fa7f7 [Hotfix] Lint for Documentation (#7817) 2020-03-30 11:49:05 -07:00
Richard LiawandGitHub 18327254b6 [docs] Fix readthedocs rendering (#7810) 2020-03-30 11:40:08 -07:00
Richard LiawandGitHub 86cff17e7e [tune/raysgd] Tune API for TorchTrainer + Fix State Restoration (#7547) 2020-03-30 12:58:49 -05:00
Edward OakesandGitHub 3a53ea60d9 [Serve] Push route table updates to HTTP proxy (#7774) 2020-03-30 09:53:05 -07:00
Tianyi ChenandGitHub f889f938e5 [streaming] Use enum to define resource type. (#7813) 2020-03-31 00:03:49 +08:00
Philipp MoritzandGitHub eb61036ba2 Revert "Pyarrow Segfault Regression Test (#7568)" (#7805)
This reverts commit 57599f075c.
2020-03-29 20:59:05 -07:00
ijrsvtandGitHub 57599f075c Pyarrow Segfault Regression Test (#7568) 2020-03-29 16:15:24 -07:00
Simon MoandGitHub 353d7e107f [Serve] Improve Serialization (#7688) 2020-03-29 14:57:19 -07:00
mehrdadnandGitHub fc23f79f82 Windows process issues (#7739) 2020-03-29 12:48:32 -07:00
fangfengbinandGitHub 6ce8b63bb6 fix TestTaskLeaseRenewal test failure (#7765) 2020-03-29 11:18:47 +08:00
Edward OakesandGitHub d87563937e Revert "[Dashboard] Metrics Export Service. (#7728)" (#7789) 2020-03-28 19:27:34 -07:00
Eric LiangandGitHub d6255c3395 Fix build breakage due to soft torch import (#7790) 2020-03-28 19:08:31 -07:00
Sven MikaandGitHub e4bd5db4d8 [RLlib] Minimal ParamNoise PR. (#7772) 2020-03-28 16:16:30 -07:00
Eric LiangandGitHub 5cebee68d6 [rllib] Add scaling guide to documentation, improve bandit docs (#7780)
* update

* reword

* update

* ms

* multi node sgd

* reorder

* improve bandit docs

* contrib

* update

* ref

* improve refs

* fix build

* add pillow dep

* add pil

* update pil

* pillow

* remove false
2020-03-27 22:05:43 -07:00
Maksim SmolinandGitHub 7b27ce2b23 [RaySGD] Convert the head worker to a local model (#7746)
Why are these changes needed?

Running a worker on head (locally, not as a Ray actor) allows for easier handling of stateful stuff like logging and for easier debugging.
2020-03-27 20:19:15 -07:00
Richard LiawandGitHub 875309fc48 Revert wide docs (#7782) 2020-03-27 17:46:08 -07:00
Richard LiawandGitHub e10dc91821 Fix doc build (#7781) 2020-03-27 17:39:38 -07:00
Mitchell SternandGitHub 090a8474b0 [Dashboard] Update dependencies and add linting rules (#7779) 2020-03-27 16:53:49 -07:00
Carl BalmerandGitHub 0cfb6488a7 changed get_agent_class to from get_trainable_cls (#7758) 2020-03-27 12:17:16 -07:00
Simon MoandGitHub 838c1e854f Add results from 0.8.3 release (#7745) 2020-03-27 11:14:15 -07:00
SangBin ChoandGitHub 86e19959a5 [Dashboard] Tune dashboard bug fix (#7766)
* Figured out why Tune was unavailable.

* Minor fix.
2020-03-27 09:02:30 -07:00
Kai YangandGitHub 6a3503c494 Fix reusing the cached hash of nil ID (#7753) 2020-03-27 23:40:03 +08:00
SongGuyangandGitHub c195dc8f88 Basic C++ worker implementation (#6125) 2020-03-27 23:01:08 +08:00
Sven MikaandGitHub 93b5c38b7d [RLlib] Noisy layers in DQN throw different errors (issue #7635). (#7750)
* Rollback.

* Fix issue 7635.

* Fix issue 7635.

* LINT and bug fix.
2020-03-26 22:08:34 -07:00
Sven MikaandGitHub 369a3417c4 [RLlib] Add tf-graph by default when doing Policy.export_model(). (#7759)
* Rollback.

* WIP.

* WIP.

* Fix.

* LINT.
2020-03-26 22:07:10 -07:00
SangBin ChoandGitHub 7a0befb0a7 [Dashboard] Metrics Export Service. (#7728) 2020-03-26 14:03:00 -07:00