wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-06-29 22:51:19 +08:00
Code Issues Packages Projects Releases Wiki Activity
6,812 Commits 36 Branches 42 Tags
python3.9
Commit Graph

6812 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Edward Oakes 1be87c7fbb [serve] Remove global state, instead access the master actor directly (#7914) 
* Move _scale() to master actor

* move create_backend

* Move set_backend_config

* Move get_backend_config

* Remove backend_table from global_state

* Remove global_state, just access master directly

* Remove accidental addition
 2020-04-07 15:21:40 -05:00
Sven Mika 81314143eb [RLlib] Use framework_iterator (add torch/eager/tf) to PPO and PG tests. (#7915) 2020-04-07 12:40:34 -07:00
Edward Oakes d3c310f408 [serve] Only access backend_table in master actor (#7913) 2020-04-07 10:12:39 -05:00
Kai Yang 48b48cc8c2 Support multiple core workers in one process (#7623) 2020-04-07 11:01:47 +08:00
micafan e91595f955 [GCS] Add ObjectLocator to gcs server (#7557) 2020-04-07 10:37:24 +08:00
Sven Mika c2cb5c2214 [RLlib] MARWIL torch. (#7836) 
* WIP.

* WIP.

* LINT.

* Fix MARWIL so it can run with eager-mode.

* LINT.
 2020-04-06 16:38:50 -07:00
Ion 9f6cbf168e New scheduler local node (#7899) 2020-04-06 14:43:42 -05:00
Richard Liaw a67edc4051 [tune] Improve user guides and API docs (#7716) 
* create guide gallery for Tune

* mods

* ok

* fix

* fix_up_gallery

* ok

* Apply suggestions from code review

Co-Authored-By: Sven Mika <sven@anyscale.io>

* Apply suggestions from code review

Co-Authored-By: Sven Mika <sven@anyscale.io>

Co-authored-by: Sven Mika <sven@anyscale.io>
 2020-04-06 12:16:35 -07:00
Sven Mika 22ccc43670 [RLlib] DQN torch version. (#7597) 
* Fix.

* Rollback.

* WIP.

* WIP.

* WIP.

* WIP.

* WIP.

* WIP.

* WIP.

* WIP.

* Fix.

* Fix.

* Fix.

* Fix.

* Fix.

* WIP.

* WIP.

* Fix.

* Test case fixes.

* Test case fixes and LINT.

* Test case fixes and LINT.

* Rollback.

* WIP.

* WIP.

* Test case fixes.

* Fix.

* Fix.

* Fix.

* Add regression test for DQN w/ param noise.

* Fixes and LINT.

* Fixes and LINT.

* Fixes and LINT.

* Fixes and LINT.

* Fixes and LINT.

* Comment

* Regression test case.

* WIP.

* WIP.

* LINT.

* LINT.

* WIP.

* Fix.

* Fix.

* Fix.

* LINT.

* Fix (SAC does currently not support eager).

* Fix.

* WIP.

* LINT.

* Update rllib/evaluation/sampler.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/evaluation/sampler.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/utils/exploration/exploration.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/utils/exploration/exploration.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* WIP.

* WIP.

* Fix.

* LINT.

* LINT.

* Fix and LINT.

* WIP.

* WIP.

* WIP.

* WIP.

* Fix.

* LINT.

* Fix.

* Fix and LINT.

* Update rllib/utils/exploration/exploration.py

* Update rllib/policy/dynamic_tf_policy.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/policy/dynamic_tf_policy.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/policy/dynamic_tf_policy.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Fixes.

* WIP.

* LINT.

* Fixes and LINT.

* LINT and fixes.

* LINT.

* Move action_dist back into torch extra_action_out_fn and LINT.

* Working SimpleQ learning cartpole on both torch AND tf.

* Working Rainbow learning cartpole on tf.

* Working Rainbow learning cartpole on tf.

* WIP.

* LINT.

* LINT.

* Update docs and add torch to APEX test.

* LINT.

* Fix.

* LINT.

* Fix.

* Fix.

* Fix and docstrings.

* Fix broken RLlib tests in master.

* Split BAZEL learning tests into cartpole and pendulum (reached the 60min barrier).

* Fix error_outputs option in BAZEL for RLlib regression tests.

* Fix.

* Tune param-noise tests.

* LINT.

* Fix.

* Fix.

* test

* test

* test

* Fix.

* Fix.

* WIP.

* WIP.

* WIP.

* WIP.

* LINT.

* WIP.

Co-authored-by: Eric Liang <ekhliang@gmail.com>
 2020-04-06 11:56:16 -07:00
Richard Liaw f63b4c1110 [sgd] make ddp optional (#7875) 
* loosen

* devices

* tryitout

* fix

* fix

* fix

* easy

* test

* fix

* fix

* better visibility

* fix
 2020-04-06 11:41:36 -07:00
mehrdadn 203c077895 Switch to Boost generic sockets (#7656) 
* Use generic Boost sockets

* Un-templatize server/client connections

Co-authored-by: Mehrdad <noreply@github.com>
 2020-04-05 22:26:46 -07:00
Sven Mika 82c2d9faba [RLlib] Fix broken RLlib tests in master. (#7894) 2020-04-05 09:34:23 -07:00
Robert Nishihara 38fad274aa Add links to 3.8 nightly wheels to docs. (#7902) 2020-04-04 21:59:45 -07:00
SangBin Cho 73fd78316d [Dashboard] Authentication (#7888) 
* Change authentication schema.

Authentication implementation.

* Formatting.

* Fix a minor style.

* Fix tests.

* Removed url validation.
 2020-04-04 19:40:54 -07:00
Allen 3c91ff1f63 [autoscaler] Allowing users to provide extra configs for AWS (#7844) 
* Allowing users to provide custom key names & security group inbound rules

* linting

* getting aws credentials passed in

* one more thing

* one more thing part 2

* formatting

* addressing comments

* update

* update

* update

* update

* update

* update

* remove tests

* rerun tests

Co-authored-by: Allen Yin <allenyin@anyscale.io>
 2020-04-04 18:36:51 -07:00
Eric Liang 630b3b1752 [rllib] set daemon status for PolicyServerInput thread (#7862) 2020-04-04 16:08:51 -07:00
acxz 11c2b500b8 [bazel] Remove deprecated and now non-existent flag (#7886) 2020-04-03 22:36:01 -07:00
acxz 7827d2c2de Add wheel build dependency (#7877) 2020-04-03 18:10:34 -07:00
ijrsvt e03f687b84 Cleaning up remaining Local Mode Code (#7865) 2020-04-03 19:54:15 -05:00
micafan 185d591108 No need to send actor died signal from RedisActorInfoAccessor (#7883) 2020-04-03 17:45:39 -07:00
Markus Cozowicz b853df7a3b [autoscaler] Switch to ARM for Azure deployment (#7717) 
* switch to ARM templates for config and VMs

* switch to ARM templates for config and VMs

* auto-formatting

* addressed Scotts comment

* added missing imports

* fixed gpu templates
fixed wheel reference

* added missing reference

* cleanup wording and yamls

* Update doc/source/autoscaling.rst

Co-Authored-By: Scott Graham <5720537+gramhagen@users.noreply.github.com>

Co-authored-by: Ubuntu <marcozo@marcozodev2.zqvgrdyupqrudayw1il1agipig.jx.internal.cloudapp.net>
Co-authored-by: Scott Graham <5720537+gramhagen@users.noreply.github.com>
 2020-04-03 15:51:56 -07:00
Sven Mika 1d4823c0ec [RLlib] Add testing framework_iterator. (#7852) 
* Add testing framework_iterator.

* LINT.

* WIP.

* Fix and LINT.

* LINT fix.
 2020-04-03 12:24:25 -07:00
Sven Mika bb6c675231 [RLlib] Bug fix: Copy is_exploring placeholder for multi-GPU tower generation. (#7846) 2020-04-03 10:44:58 -07:00
Sven Mika 5537fe13b0 [RLlib] Exploration API: ParamNoise Integration into DQN; working example/test cases. (#7814) 2020-04-03 10:44:25 -07:00
Qing Wang 1b477c6dd0 [Streaming] Fix streaming CI failure. (#7869) 2020-04-03 10:45:25 +08:00
SangBin Cho 1d532d1cb8 [Dashboard ]Action Implementation. (#7826) 2020-04-02 18:02:37 -07:00
Simon Mo a3181816b3 Add result from 0.8.4 release (#7876) 2020-04-02 15:31:03 -07:00
Edward Oakes 7f9ddfcfd8 Only access route_table and policy_table in master actor (#7835) 2020-04-02 14:44:53 -07:00
Edward Oakes cbe494ab13 [flaky test] Fix flaky test_heartbeats_single (#7857) 2020-04-02 16:23:28 -05:00
Richard Liaw 314250d072 [docs] Make Ray slack more prominent (#7870) 2020-04-02 11:14:02 -07:00
Sven Mika 7b08db9f8c [RLlib] Remove all instances of tf.contrib.layers. ... from RLlib code (deprecated). (#7851) 2020-04-01 18:03:14 -07:00
ijrsvt 9bfc2c4b54 Moving Local Mode to C++ (#7670) 2020-04-01 15:50:57 -05:00
mehrdadn 65054a2c7c Python 3.8 compatibility (#7754) 2020-04-01 10:03:23 -07:00
Richard Liaw 24bf6ad607 [raysgd] Improve raysgd examples (#7818) 
* better_example

* test

* improve some usability things

* submit

* fix

* flake

* Update python/ray/util/sgd/torch/training_operator.py

* trythis

* fix

* fix

* smoke

* fail

* fix

* fix
 2020-04-01 08:58:39 -07:00
Edward Oakes f4239d27fa [serve] Create all other actors in master actor (#7791) 2020-04-01 10:15:04 -05:00
Robert Nishihara b011c604d7 Remove ray.tasks() from API. (#7807) 2020-04-01 10:10:40 -05:00
micafan 780c1c3b08 [GCS] impl RedisStoreClient for GCS Service (#7675) 2020-04-01 21:18:19 +08:00
Sven Mika e153e3179f [RLlib] Exploration API: Policy changes needed for forward pass noisifications. (#7798) 
* Rollback.

* WIP.

* WIP.

* LINT.

* WIP.

* Fix.

* Fix.

* Fix.

* LINT.

* Fix (SAC does currently not support eager).

* Fix.

* WIP.

* LINT.

* Update rllib/evaluation/sampler.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/evaluation/sampler.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/utils/exploration/exploration.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/utils/exploration/exploration.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* WIP.

* WIP.

* Fix.

* LINT.

* LINT.

* Fix and LINT.

* WIP.

* WIP.

* WIP.

* WIP.

* Fix.

* LINT.

* Fix.

* Fix and LINT.

* Update rllib/utils/exploration/exploration.py

* Update rllib/policy/dynamic_tf_policy.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/policy/dynamic_tf_policy.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Update rllib/policy/dynamic_tf_policy.py

Co-Authored-By: Eric Liang <ekhliang@gmail.com>

* Fixes.

* LINT.

* WIP.

Co-authored-by: Eric Liang <ekhliang@gmail.com>
 2020-04-01 00:43:21 -07:00
Sven Mika 66df8b8c35 [RLlib] Working/learning example: PPO + torch + LSTM. (#7797) 2020-03-31 22:00:28 -07:00
SangBin Cho c23e56ce9a Metrics Export Service (#7809) 2020-03-30 23:28:32 -07:00
fangfengbin bfb9248532 fix gcs server resolver error (#7822) 
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-03-30 22:57:55 -07:00
mehrdadn 8958728139 Windows bug fixes (#7740) 2020-03-30 20:39:23 -05:00
Simon Mo dc9b62e007 Deserialize Args in Event Loop Thread (#7806) 2020-03-30 18:28:13 -07:00
mehrdadn f86e623095 Fix & improve GitHub Actions CI builds (#7784) 2020-03-30 16:29:54 -07:00
Sven Mika e356e97eb2 [RLlib] Assert correct policy class being used in Worker. (#7769) 2020-03-30 14:03:29 -07:00
Richard Liaw fbf02fa7f7 [Hotfix] Lint for Documentation (#7817) 2020-03-30 11:49:05 -07:00
Richard Liaw 18327254b6 [docs] Fix readthedocs rendering (#7810) 2020-03-30 11:40:08 -07:00
Richard Liaw 86cff17e7e [tune/raysgd] Tune API for TorchTrainer + Fix State Restoration (#7547) 2020-03-30 12:58:49 -05:00
Edward Oakes 3a53ea60d9 [Serve] Push route table updates to HTTP proxy (#7774) 2020-03-30 09:53:05 -07:00
Tianyi Chen f889f938e5 [streaming] Use enum to define resource type. (#7813) 2020-03-31 00:03:49 +08:00