Commit Graph

5785 Commits

Author SHA1 Message Date
Kai Yang edd9916e30 Fix Java CI crash caused by incorrect destruction order in core worker (#10709) 2020-09-14 17:17:34 +00:00
Alex Wu df77a31242 [Autoscaler] Unmanaged nodes (#10513) 2020-09-14 17:14:06 +00:00
Ian Rodney 049b7b2017 [docker] Revert to rsync & cp instead of file mount for bootstrap config/key (#10734) 2020-09-14 17:13:06 +00:00
Ian Rodney 0592dcacba [autoscaler] Fix rsync file mounts (#10721) 2020-09-14 17:12:33 +00:00
Ian Rodney 686c389562 [autoscaler] use default value (#10706) 2020-09-14 17:12:15 +00:00
Ian Rodney 826a9253c6 [docker] Detect CPUs in container correctly (#10507)
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-14 17:11:47 +00:00
Richard Liaw fe23f23680 [tune/rllib] revert removal of queue-trials (#10744) 2020-09-14 17:11:20 +00:00
Eric Liang 70305267d2 Remove colorful from ray core (#10723) 2020-09-14 17:09:56 +00:00
Alex Wu 72e19ede28 [hotfix] accelerator_types (#10725)
* .

* .
2020-09-14 17:09:28 +00:00
Alex Wu c4aaeab256 [Autoscaler] Fix utilization calc (#10728) 2020-09-14 17:08:58 +00:00
Alex Wu c2156c3ffa [hotfix] Autoscaler's K8 support (#10766)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-14 17:08:28 +00:00
Richard Liaw cb4ebb86c0 [autoscaler] make commands very explicit on logs (#10713) 2020-09-10 21:08:40 +00:00
Richard Liaw 9c6ab77d54 [autoscaler] Create provider exactly once (#10703)
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-10 21:08:23 +00:00
Kai Fricke 9bae286f42 [tune] wandb log cleaning to use yaml representer (#10680)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-10 21:07:49 +00:00
Barak Michener fa304a90ee Bump version number everywhere to 1.0.0 2020-09-09 18:35:14 +00:00
Max Fitton 3e8164ff8a [Dashboard] Logical View Actor Class Grouping Details (#10453)
* wip

* wip

* wip

* wip

* Need to track the timestamp actors are created for the dashboard. This adds that functionality back in and deletes unused code

* Add the materialui lab packages to get access to the Alert component and fix up some vulnerabilities with npm audit.

* Finish supporting information on a per-actor-class basis in the logical view, add bug fixes around timestamps and infeasible task names, and add a new warning popup that shows if there are infeasible actors around.

* lint and add seconds annotation to actor lifetime values

* real lint

* remove typo

* Somehow missed something last lint

* Add new comments for actor states

* Add underscores to some private functions

* Add tooltips to the actor states on the logical view

* change test metrics to be aligned with new changes.

* lint

* Remove some unnecessary log lines and catch error that happens when we try to decode data from an unexpected source

* Re-add a function I had removed. It is used in the Java codebase.

Co-authored-by: Max Fitton <max@semprehealth.com>
2020-09-09 10:34:54 -07:00
desktable 799318d7d7 [RLlib] Add type annotations for agents/dqn (#10626) 2020-09-09 18:55:26 +02:00
Richard Liaw 153813936b [tune] auto infer metrics (#10663)
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-09-09 09:53:47 -07:00
Richard Liaw 3501ea396c [tune] All examples to use ConcurrencyLimiter (#10662)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-09-09 09:52:15 -07:00
Alex Wu cd5b99e5e0 [hotfix] redis_password -> _redis_password (#10672) 2020-09-09 09:40:49 -07:00
Sven Mika 4b278c36fc [RLlib] Behavioral Cloning (from MARWIL). (#10619) 2020-09-09 17:33:21 +02:00
Kai Yang afa0216280 Remove the '--include-java' option (#10594) 2020-09-09 17:01:17 +08:00
chaokunyang ccf27a9ad2 [Streaming] Fix streaming ci (#10665) 2020-09-09 16:53:43 +08:00
chaokunyang 72ac85c19e [Java] remove resetLibraryPath (#10671) 2020-09-09 15:46:37 +08:00
chaokunyang a96af94e56 [Java] add developer section (#10670) 2020-09-09 15:45:49 +08:00
Michael Luo 8e613652af [RLLib] MBMPO Fixes (#10296) 2020-09-09 09:34:34 +02:00
Hao Chen d22980a5c3 [Hotfix] fix bug about code_search_path in JobConfig (#10666) 2020-09-09 15:28:45 +08:00
Kai Fricke d7c7aba99c [tune] Tune experiment analysis improvements (#10645)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 21:00:52 -07:00
Alex Wu d9c68fca5c [Core] Logging improvements (#10625)
* other stuff
:

* lint

* .

* .

* lint

* comment

* lint

* .
2020-09-08 20:58:05 -07:00
SangBin Cho b7040f1310 Revert "[Streaming] fix streaming ci (#9675)" (#10656)
This reverts commit 3645a05644.
2020-09-08 19:07:21 -07:00
Kai Fricke 756a9ea641 [tune] add mode/metric parameters to tune.run (#10627)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 17:06:21 -07:00
Richard Liaw edce7a05e6 [docs] fix warning -> tip (#10661)
Co-authored-by: simon-mo <simon.mo@hey.com>
2020-09-08 17:00:09 -07:00
Simon Mo 5a38a76c83 [Doc] Use sphinx_book_theme (#10379) 2020-09-08 16:25:23 -07:00
Alex Wu 3166693b29 [Core] Fix flaky test_failure (#10632) 2020-09-08 15:47:25 -07:00
SangBin Cho 30fff71d96 087release update (#10651)
* [BRING BACK TO MASTER] Release test result for microbenchmark.

* [BRING BACK TO MASTER] Update result and fix sanity check bugs.
2020-09-08 15:45:06 -07:00
Kai Fricke 87c4f36f02 [tune] Added timeout parameter to tune.run(), (#10642) 2020-09-08 15:38:28 -07:00
Amog Kamsetty 415be78cc0 [RaySGD] Simplify Builder Process (#10321)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 15:19:40 -07:00
Kai Fricke 69c1a9dd08 [tune] clean up logs before logging to wandb (#10654)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 14:48:18 -07:00
SangBin Cho dcb9e03fde [Placement Group] Atomic Creation using 2 phase protocol part 2. (#10599)
* In progress.

* In Progress

* Basic done.

* Fix build issues.

* Addressed code review.

* Change the confusing test name.

* Fix comments.

* Addressed code review.
2020-09-08 13:11:11 -07:00
Clark Zinzow 36e1f20e9c Add Dask-Ray scheduler callbacks. (#10519)
Improve Dask-on-Ray documentation.

Move to RayCallback(s) namedtuples, and use top-level CBS tuple as source-of-truth for callback methods.
2020-09-08 13:00:58 -07:00
Simon Mo fdd3acd492 Promote ray.experimental.queue to ray.util (#10624) 2020-09-08 12:56:53 -07:00
Simon Mo 8d5b8b2956 [Serve] Fix handle args data type issue (#10629) 2020-09-08 12:32:42 -07:00
Richard Liaw 5851e893ee [tune] More robust resolution/detection of signature (#10365)
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-09-08 11:38:16 -07:00
Ian Rodney 39c598bab0 [docker] No Docker CP if File Mount (#10633) 2020-09-08 10:25:24 -07:00
chaokunyang bbfbc98a41 [Core] Allow users to specify the classpath and import path (#10560)
* move job resource path to job config

* job resource path support list

* job resource path support for python

* fix job_resource_path support

* fix worker command

* fix job config

* use jar file instead of parent path

* fix job resource path

* add test to test.sh

* lint

* Update java/runtime/src/main/resources/ray.default.conf

Co-authored-by: Kai Yang <kfstorm@outlook.com>

* fix testGetFunctionFromLocalResource

* lint

* fix rebase

* add jars in resource path to classloader

* add job_resource_path to worker

* add ray stop

* rename job_resource_path to resource_path

* fix resource_path

* refine resource_path comments

* rename job resource path to code search path

* Add instruction about starting a cross-language cluster

* fix ClassLoaderTest.java

* add code-search-path to RunManager

* refine comments for code-search-path

* rename resourcePath to codeSearchPath

* Update doc

* fix

* rename resourcePath to codeSearchPath

* update doc

* filter out empty path

* fix comments

* fix comments

* fix tests

* revert pom

* lint

* fix doc

* update doc

* Apply suggestions from code review

* lint

Co-authored-by: Kai Yang <kfstorm@outlook.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-09-09 00:46:32 +08:00
chaokunyang 3645a05644 [Streaming] fix streaming ci (#9675) 2020-09-08 22:20:58 +08:00
Kai Yang aa79542c77 [Java] Fix ClassLoaderTest (#10647) 2020-09-08 22:09:26 +08:00
Hao Chen f9098fe631 [Java doc] index and introduction page (#10646) 2020-09-08 22:00:46 +08:00
fyrestone d2614d222c [Doc] Cross language page (#10471) 2020-09-08 16:51:40 +08:00
Lixin Wei 2b95e71dac [Streaming] Test build fixed (#10617) 2020-09-08 14:31:54 +08:00