Commit Graph

4989 Commits

Author SHA1 Message Date
Michael Luo eb8eb2c71a [RLLib] DM Control Suite Wrapper and Examples (#9031)
* DM Control Suite Added

* Added License

* Changes

* Test fixes
2020-06-29 17:58:29 -07:00
krfricke e0b6984dce [tune] pytorch lightning template and walkthrough (#9151)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-06-29 16:52:07 -07:00
SangBin Cho 1e79730eee Add GCS actor management CI build (#9194) 2020-06-29 15:42:41 -05:00
SangBin Cho 7af6c69672 [Test] Cluster util fix (#8929) 2020-06-29 14:15:41 -05:00
mehrdadn e060d99c6e Bazel: strip_prefix=True should strip leading 'v' (#9175)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-29 11:27:56 -07:00
Edward Oakes 87e47c4a53 Fix serve dependencies (#9192) 2020-06-29 12:44:04 -05:00
mehrdadn bc140b69cc Patch WSL psutil bug (#6808) 2020-06-29 10:55:43 -05:00
mehrdadn f4e5561ef7 Fix build error (#9185)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-29 14:51:01 +08:00
chaokunyang ab8df7afa3 Refine GetNamedActorHandle acync rpc wait (#9078) 2020-06-29 10:52:38 +08:00
Alex Wu f8ecf6de71 Small fix (#9149)
Fixes some basic test cases
2020-06-28 13:43:03 -07:00
mehrdadn 8f72a9fd1a Fix more Windows tests (#9173) 2020-06-28 17:13:15 +08:00
fangfengbin 1dc018d0bb Add gcs service discovery to automatically detect GCS server restart (#8735) 2020-06-28 16:50:06 +08:00
Zhilei Chen d78128a69c Refactor GcsJobInfoHandle to GcsJobManager and filename (#9112) 2020-06-28 16:10:13 +08:00
mehrdadn aac40af948 Fix some nonstandard code (#9172)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-28 00:22:52 -07:00
Tao Wang a268277f38 [BUILD]use first appearance of import when check order (#9119) 2020-06-28 11:04:29 +08:00
mehrdadn 898e472425 Make test_utils.py use pipes to avoid file access conflicts on Windows (#9072)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-27 22:33:45 +02:00
Richard Liaw 625b66bde7 [docs] Show commands on documentation (#9165) 2020-06-27 12:56:56 -07:00
Sven Mika d6f84bb072 Win10 setup-dev.py fixes. (#9169) 2020-06-27 21:28:11 +02:00
Sven Mika 5c6d5d4ab1 This PR fixes the currently broken lstm_use_prev_action_reward flag for default lstm models (model.use_lstm=True). (#8970) 2020-06-27 20:50:01 +02:00
Siyuan (Ryans) Zhuang d7549d6184 Replace arrow::Status with ray::Status in Plasma (#9154)
* add object store status

* replace arrow status with ray status

* cleanup

* remove plasma common.cc
2020-06-26 14:06:34 -07:00
Dean Wampler b7cc1e78d7 Removed obsolete "detached=True" for detached actor in documentation. (#9158)
* Added small section on installation when using Anaconda. Also fixed an obsolete link to Anaconda.

* Delete more temporary directories when running the doc "make clean".

* Fixed typo in LinearDiscreteEnv docs

* Removed the "detached=True" from the description of detachted actors, because it is now deprecated.

Co-authored-by: Dean Wampler <dean@concurrentthought.com>
2020-06-26 09:47:41 -07:00
Richard Liaw 56d934bc18 [docs] Revised Cluster documentation (#9062)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-06-26 09:29:22 -07:00
Sven Mika af1203b9df [RLlib] Issue 8507 (PyTorch does not support custom loss). (#9142) 2020-06-26 09:52:22 +02:00
Sven Mika e93a1a82ab Issue 8407: RNN sequencing error in QMIX (#9139) 2020-06-26 09:50:31 +02:00
Ian Rodney f940ccd6fb [autoscaler] Better explain min/max/initial worker settings (#9132) 2020-06-25 20:38:03 -07:00
Ian Rodney 42631c5b87 [autoscaler/docker] Migrate --docker to --run-env (#9001) 2020-06-25 20:37:42 -07:00
mehrdadn 11bda7272b [windows] Work around msgpack issue on PowerPC64LE (#9140)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-25 20:36:22 -07:00
Stephanie Wang 490cddc250 [core] Refactor distributed ref counting to remove owner task ID (#9049)
* Add intended worker ID to GetObjectStatus, tests

* Remove TaskID owner_id

* lint

* Update message

* lint

* Fix build
2020-06-25 17:55:03 -07:00
krfricke 22ea8dde84 [Tune] Added XGBoost tutorial and template (#9060)
* Added XGBoost tutorial and template

* XGBoost tutorial: Cut some clutter

* Apply suggestions from code review

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Added XGboost logo

* Fixed further references

Co-authored-by: Kai Fricke <kai@anyscale.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-06-25 15:59:54 -07:00
mehrdadn ab3413c124 Make process termination more robust (#9081) 2020-06-25 15:30:53 -05:00
Richard Liaw 75e6775b36 [docs] Make Contributions/Building pages more prominent (#9054)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-06-25 12:38:12 -07:00
mehrdadn 07655036d2 [tune] os.replace() instead of os.rename() for cross-platform (#9141)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-25 12:30:51 -07:00
Xianyang Liu 0bfcc2e5ba [core] Better support multi-nic environments by respecting user-provided IP (#8512) 2020-06-25 14:03:12 -05:00
Alex Wu 46962f5db1 [Core] Log monitor multidriver (#8953) 2020-06-25 11:05:53 -07:00
Eric Liang 4522038259 [iter] Add .transform() function for arbitrary generator transforms (#8978) 2020-06-25 11:04:14 -07:00
henktillman 0f1d99befc [autoscaler] Remove Fingerprint checking (#9133) 2020-06-25 10:22:54 -07:00
Sven Mika 4fd8977eaf [RLlib] Minor cleanup in preparation to tf2.x support. (#9130)
* WIP.

* Fixes.

* LINT.

* Fixes.

* Fixes and LINT.

* WIP.
2020-06-25 19:01:32 +02:00
Edward Oakes aa3fd62cac [serve] Add shadow traffic API (#9106) 2020-06-25 10:55:22 -05:00
Eric Liang 536795ef79 [autoscaler] Initial support for multiple worker types (#9096)
* wip

* fix

* update

* debug state

* fix

* update

* update

* fix test

* fix

* fix

* update

* fix

* types and docs

* update
2020-06-24 23:08:30 -07:00
Eric Liang 0ff24ec8dc Add "ray status" debug tool for autoscaler. (#9091) 2020-06-24 18:22:03 -07:00
Siyuan (Ryans) Zhuang 80bcbe20c7 [Core] Remove object notification IPC between Plasma and Raylet (initial step) (#8939)
* initial refactoring

redirect notifications to eventloop

implement direct notifications

* protect vector with mutex
2020-06-24 13:54:40 -07:00
ElektroChan89 4bc1d7c043 [docs] Update grid_random.rst (#9102) 2020-06-24 12:36:42 -07:00
Ian Rodney 67e049bc7b [autoscaler/docker] Relax missing docker section (#9105) 2020-06-24 12:35:42 -07:00
mehrdadn 0487c250e8 Windows compatibility (#93)
Co-authored-by: mehrdadn <mehrdadn@users.noreply.github.com>
Co-authored-by: Mehrdad <noreply@github.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-06-24 11:27:28 -07:00
SongGuyang cbf38573bd C++ worker API refactoring (#9053) 2020-06-24 19:33:46 +08:00
Sven Mika aa231799ed Dyna test: small -> medium. (#9118) 2020-06-24 12:02:44 +02:00
Siyuan (Ryans) Zhuang 613abdf1b6 Remove arrow macros in plasma store (#9115) 2020-06-23 23:34:44 -07:00
mehrdadn 98d68b31c3 Suppress GRPC SO_REUSADDR warning on Linux (#7972)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-23 21:58:43 -07:00
Alex Wu c152730e4a [Core] Log output from different jobs to different drivers. (#8885)
* .

* .

* Correct now

* No interactivity errors

* format

* Filtering

* lint

* .

* No more filtering

* Removed interactivity

* .

* .

* .

* .

* .

* .

* Redirection works

* formatting

* something broken?

* .

* Works

* formatting

* redirect output

* formatting

* formatting

* Fix file descriptor leakage

* format

* .

* .

* .

* .

* .

* Refactor

* .

* Only run on job switch

* .

* cleanup

* .

* ...

* Review

* .

* .

* .

* .

* whoops

* .

* Should fix bug

* .

* .

* addressed comments

* formatting

* formatting

* Fix typo

* .

* .

* .

* .

Co-authored-by: Ubuntu <ubuntu@ip-172-31-14-33.us-west-2.compute.internal>
2020-06-23 18:45:32 -07:00
henktillman acb3280235 GCP credentials (#9052) 2020-06-23 17:11:18 -07:00