Commit Graph
4584 Commits
Author SHA1 Message Date
gehringandGitHub 7f14fb577d [RLlib] Added TransformerXL and "stabilized for RL" variant, GTrXL (#6470) 2020-05-08 14:10:23 +02:00
Eric LiangandGitHub 2c599dbf05 [rllib] Port QMIX, MADDPG to new execution API (#8344) 2020-05-07 23:41:10 -07:00
Eric LiangandGitHub 9f04a65922 [rllib] Add PPO+DQN two trainer multiagent workflow example (#8334) 2020-05-07 23:40:29 -07:00
Sven MikaandGitHub d7eaacb5fe [RLlib] Issue 8319 DDPG (MA or num_envs_per_worker > 1) broken. (#8324) 2020-05-08 08:26:32 +02:00
Sven MikaandGitHub 5f278c6411 [RLlib] Examples folder restructuring (models) part 1 (#8353) 2020-05-08 08:20:18 +02:00
Eric LiangandGitHub 413db0902d Trigger global GC when resources may be occupied by deleted actors 2020-05-07 14:57:21 -07:00
Edward OakesandGitHub f2f118df9e [serve] Clear serve cluster state between tests. (#8357) 2020-05-07 16:45:20 -05:00
Eric LiangandGitHub 30db920787 [rllib] Fix centralized critic example to use right policy (#8341)
* update

* update
2020-05-07 10:47:55 -07:00
Philipp MoritzandGitHub 325aec81bd Hide aliased autoscaler commands (#8348) 2020-05-07 10:17:59 -07:00
Sven MikaandGitHub 2b0817cbd3 [RLlib] Retry pip installs (after waiting n seconds) in install-dependencies.sh (#8354) 2020-05-07 17:39:35 +02:00
fangfengbinandGitHub dd3c050168 GCS adapts to batch heartbeat table pub sub (#8346) 2020-05-07 20:33:36 +08:00
fangfengbinandGitHub 620ea94873 Fix node manager miss object info bug (#8337) 2020-05-07 20:16:42 +08:00
Eric LiangandGitHub bc8b606ad7 [rllib] All test suites show up as RLLIB_TESTING=1 only. 2020-05-06 23:11:13 -07:00
Simon MoandGitHub c5a5a5de89 [Serve] Refactor Metric System: Counter + Measure Support (#8114) 2020-05-06 17:44:02 -07:00
Eric LiangandGitHub 1f312debbe Document all ray commands. (#8340) 2020-05-06 16:49:37 -07:00
SangBin ChoandGitHub e631827a9f [Core] Show_webui segfault fix. (#8323) 2020-05-06 11:45:07 -05:00
Alex WuandGitHub 04813c2ef5 [Parallel Iterator] Foreach concur (#8140) 2020-05-06 10:00:01 -05:00
Thomas DesrosiersandGitHub ec9357b486 [autoscaler] Fix filesystem permission race conditions (#8327) 2020-05-05 17:22:03 -07:00
Eric LiangandGitHub b14cc16616 [rllib] Enable functional execution workflow API by default (#8221) 2020-05-05 12:36:42 -07:00
mehrdadnandGitHub 4bdef78e2e Various CI fixes and cleanup (#8289) 2020-05-05 10:47:49 -07:00
fangfengbinandGitHub 97430b2d0f GCS adapts to node table pub sub (#8209) 2020-05-05 18:34:41 +08:00
Eric LiangandGitHub ee0eb44a32 Rename async_queue_depth -> num_async (#8207)
* rename

* lint
2020-05-05 01:38:10 -07:00
Eric LiangandGitHub f48da50e1c [rllib] observation function api for multi-agent (#8236) 2020-05-04 22:13:49 -07:00
Simon MoandGitHub 1480bf4295 [Serve] Improve batch size inconsistency error (#8315) 2020-05-04 20:32:12 -07:00
Simon MoandGitHub ca929671b6 [Serve] Simplify Validation (#8316) 2020-05-04 20:31:23 -07:00
e93ec3134a Use kubectl delete pod in example (#8295)
Co-authored-by: rbusche <rbusche@inserve.de>
2020-05-04 21:39:30 -05:00
5dd9dbf74f Add ipython as dependency for autoscaler container (#8297)
Co-authored-by: rbusche <rbusche@inserve.de>
2020-05-04 21:22:38 -05:00
fangfengbinandGitHub 14d03a0869 GCS adapts to task lease table pub sub (#8299) 2020-05-05 10:16:56 +08:00
ijrsvtandGitHub cc7bd6650a [core] Enabling Remote Task Cancelation (#8225) 2020-05-04 15:24:22 -07:00
Sven MikaandGitHub 6c2b9a4cfa [RLlib] Remove tf.py_function from all Schedule classes (not differentiable and causes other bugs in MA setups). (#8304)
Remove tf.py_function from all Schedule classes (not differentiable and causes other bugs in MA setups). (#8304)
2020-05-04 23:53:38 +02:00
Sven MikaandGitHub a00144f746 [RLlib] Fix issue 8135 (DDPG inf actions when using [-inf,inf] action space). (#8302) 2020-05-04 22:27:30 +02:00
8625e09067 Actor manager refactor and unit tests (#8224)
* parametrize test

* Regression test and logging

* Test no restart after actor deletion

* Unit tests

* Refactor to subscribe to and lookup from worker failure table

* Refactor ActorManager to remove dependencies

* Revert "Regression test and logging"

This reverts commit 835e1a9091b51ca8efb00392d4cc4a665145de24.

* Revert "parametrize test"

This reverts commit f31272082831ba1a494816dd5511d87b24eca4c9.

* Revert "Test no restart after actor deletion"

This reverts commit 114a83de14329aa6ab787c80cd5757cf074a9072.

* doc

* merge

* Revert "Refactor to subscribe to and lookup from worker failure table"

This reverts commit 6aa13a05178d0b9aa1db9dee5c978c911b74fa3a.

* Use actor ID instead of shared_ptr

* TODO and lint

* Update src/ray/gcs/gcs_server/gcs_actor_scheduler.h

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>

* Fix build

* doc

* Build

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-05-04 10:16:52 -07:00
Sven MikaandGitHub b95e28faea [RLlib] APEX_DDPG (PyTorch) test case and docs. (#8288)
APEX_DDPG (PyTorch) test case and docs.
2020-05-04 09:36:27 +02:00
fangfengbinandGitHub 5f351a05fe GCS adapts to task table pub sub (#8210) 2020-05-04 10:23:55 +08:00
IonandGitHub e24276e3c1 New scheduler int capacities (#8192)
* working version

* working version

* done

* done

* done

* addressing most of Philipp comments

* addressing most of Philipp comments
2020-05-03 18:47:30 -07:00
Sven MikaandGitHub 2c71559b3a [RLlib] Fixes duplicate learning tests in travis.yaml. (#8293)
Fixes duplicate learning tests in travis.yaml.
2020-05-03 20:27:29 +02:00
fangfengbinandGitHub b7bbc3bc83 [GCS]GCS adapts to object table pub sub (#8180) 2020-05-03 21:44:33 +08:00
Sven MikaandGitHub 166bb5d690 [RLlib] IMPALA PyTorch (#8287)
This PR adds an IMPALA PyTorch implementation.

- adds compilation tests for LSTM and w/o LSTM.
- adds learning test for CartPole.
2020-05-03 13:44:25 +02:00
Eric LiangandGitHub 1228369a87 Remove "This tab is experimental" (#8281) 2020-05-02 22:41:28 -07:00
Simon MoandGitHub ec6631ae58 Pin redis-py version (#8290) 2020-05-02 22:09:02 -07:00
Stephanie WangandGitHub b4ef500675 [core] Disable GCS actor management (#8271) 2020-05-02 22:02:56 -07:00
SangBin ChoandGitHub 0f54d5ab65 Async actor microbenchmark Script (#8275) 2020-05-02 21:51:00 -07:00
Richard LiawandGitHub 40dfb337bf [tune] Hotfix Ax breakage when fixing backwards-compat (#8285) 2020-05-02 20:42:50 -07:00
Xianyang LiuandGitHub eda526c154 [SGD] Support multiple input model (#8246) 2020-05-02 16:49:09 -07:00
Maksim SmolinandGitHub c2acb7ffe2 [SGD] Add imagenet example CI (#8150) 2020-05-02 16:48:35 -07:00
Edward OakesandGitHub 518ef4c0b3 [serve] Increase timeout waiting for HTTP server (#8286) 2020-05-02 16:55:13 -05:00
mehrdadnandGitHub ff68fb8c7c Try to fix tests running all the time (#8280)
Co-authored-by: Mehrdad <noreply@github.com>
2020-05-02 15:37:52 -05:00
Edward OakesandGitHub 22cab930cd Retry actor failures in serve failure test (#8282) 2020-05-02 10:19:44 -05:00
Edward OakesandGitHub 8d3236f1d0 Lower test_utils.wait_for_condition default timeout to 30s (#8283) 2020-05-02 10:19:00 -05:00
Sven MikaandGitHub 76e1a4df9e Fix TD3 torch via GaussianNoise torch bug. (#8276) 2020-05-02 08:12:21 +02:00