Commit Graph

6812 Commits

Author SHA1 Message Date
chaokunyang 72ac85c19e [Java] remove resetLibraryPath (#10671) 2020-09-09 15:46:37 +08:00
chaokunyang a96af94e56 [Java] add developer section (#10670) 2020-09-09 15:45:49 +08:00
Michael Luo 8e613652af [RLLib] MBMPO Fixes (#10296) 2020-09-09 09:34:34 +02:00
Hao Chen d22980a5c3 [Hotfix] fix bug about code_search_path in JobConfig (#10666) 2020-09-09 15:28:45 +08:00
Kai Fricke d7c7aba99c [tune] Tune experiment analysis improvements (#10645)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 21:00:52 -07:00
Alex Wu d9c68fca5c [Core] Logging improvements (#10625)
* other stuff
:

* lint

* .

* .

* lint

* comment

* lint

* .
2020-09-08 20:58:05 -07:00
SangBin Cho b7040f1310 Revert "[Streaming] fix streaming ci (#9675)" (#10656)
This reverts commit 3645a05644.
2020-09-08 19:07:21 -07:00
Kai Fricke 756a9ea641 [tune] add mode/metric parameters to tune.run (#10627)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 17:06:21 -07:00
Richard Liaw edce7a05e6 [docs] fix warning -> tip (#10661)
Co-authored-by: simon-mo <simon.mo@hey.com>
2020-09-08 17:00:09 -07:00
Simon Mo 5a38a76c83 [Doc] Use sphinx_book_theme (#10379) 2020-09-08 16:25:23 -07:00
Alex Wu 3166693b29 [Core] Fix flaky test_failure (#10632) 2020-09-08 15:47:25 -07:00
SangBin Cho 30fff71d96 087release update (#10651)
* [BRING BACK TO MASTER] Release test result for microbenchmark.

* [BRING BACK TO MASTER] Update result and fix sanity check bugs.
2020-09-08 15:45:06 -07:00
Kai Fricke 87c4f36f02 [tune] Added timeout parameter to tune.run(), (#10642) 2020-09-08 15:38:28 -07:00
Amog Kamsetty 415be78cc0 [RaySGD] Simplify Builder Process (#10321)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 15:19:40 -07:00
Kai Fricke 69c1a9dd08 [tune] clean up logs before logging to wandb (#10654)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 14:48:18 -07:00
SangBin Cho dcb9e03fde [Placement Group] Atomic Creation using 2 phase protocol part 2. (#10599)
* In progress.

* In Progress

* Basic done.

* Fix build issues.

* Addressed code review.

* Change the confusing test name.

* Fix comments.

* Addressed code review.
2020-09-08 13:11:11 -07:00
Clark Zinzow 36e1f20e9c Add Dask-Ray scheduler callbacks. (#10519)
Improve Dask-on-Ray documentation.

Move to RayCallback(s) namedtuples, and use top-level CBS tuple as source-of-truth for callback methods.
2020-09-08 13:00:58 -07:00
Simon Mo fdd3acd492 Promote ray.experimental.queue to ray.util (#10624) 2020-09-08 12:56:53 -07:00
Simon Mo 8d5b8b2956 [Serve] Fix handle args data type issue (#10629) 2020-09-08 12:32:42 -07:00
Richard Liaw 5851e893ee [tune] More robust resolution/detection of signature (#10365)
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-09-08 11:38:16 -07:00
Ian Rodney 39c598bab0 [docker] No Docker CP if File Mount (#10633) 2020-09-08 10:25:24 -07:00
chaokunyang bbfbc98a41 [Core] Allow users to specify the classpath and import path (#10560)
* move job resource path to job config

* job resource path support list

* job resource path support for python

* fix job_resource_path support

* fix worker command

* fix job config

* use jar file instead of parent path

* fix job resource path

* add test to test.sh

* lint

* Update java/runtime/src/main/resources/ray.default.conf

Co-authored-by: Kai Yang <kfstorm@outlook.com>

* fix testGetFunctionFromLocalResource

* lint

* fix rebase

* add jars in resource path to classloader

* add job_resource_path to worker

* add ray stop

* rename job_resource_path to resource_path

* fix resource_path

* refine resource_path comments

* rename job resource path to code search path

* Add instruction about starting a cross-language cluster

* fix ClassLoaderTest.java

* add code-search-path to RunManager

* refine comments for code-search-path

* rename resourcePath to codeSearchPath

* Update doc

* fix

* rename resourcePath to codeSearchPath

* update doc

* filter out empty path

* fix comments

* fix comments

* fix tests

* revert pom

* lint

* fix doc

* update doc

* Apply suggestions from code review

* lint

Co-authored-by: Kai Yang <kfstorm@outlook.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-09-09 00:46:32 +08:00
chaokunyang 3645a05644 [Streaming] fix streaming ci (#9675) 2020-09-08 22:20:58 +08:00
Kai Yang aa79542c77 [Java] Fix ClassLoaderTest (#10647) 2020-09-08 22:09:26 +08:00
Hao Chen f9098fe631 [Java doc] index and introduction page (#10646) 2020-09-08 22:00:46 +08:00
fyrestone d2614d222c [Doc] Cross language page (#10471) 2020-09-08 16:51:40 +08:00
Lixin Wei 2b95e71dac [Streaming] Test build fixed (#10617) 2020-09-08 14:31:54 +08:00
Kai Yang ca8792e4ff [Java] Disable the multi-worker feature by default (#10593) 2020-09-08 13:10:46 +08:00
Lixin Wei 66e125d6e6 [Streaming] Remove useless generated protobuf directory to fix CI. (#10616) 2020-09-08 12:19:59 +08:00
fyrestone 226a1824b8 Improve cross language serialization (#10490) 2020-09-08 12:18:13 +08:00
Richard Liaw 41bf5f3de0 [tune] change trial dir default to include name (#10608) 2020-09-07 19:45:13 -07:00
kisuke95 b7003839bd [Core] Use core worker options to initialize (#10467)
* fix

* fix

* .
2020-09-07 16:36:43 -07:00
Edward Oakes 8db1f16f25 [tune] wandb - api_key_file clarification (#10614)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-07 16:31:50 -07:00
Kai Fricke 088f8ebb69 [tune] Add algorithms for search space conversion (#10621) 2020-09-07 13:44:16 -07:00
Ian Rodney 99625d0bce [docker] Build images with nightly tag for non branch images (#10596) 2020-09-07 11:08:18 -07:00
Richard Liaw 169c3a46de [k8s] Broken Command Interactivity (#10297)
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-07 09:56:41 -07:00
Kai Yang bd37ebb163 [Java] Fix checkstyle of UsingActorsDemo.java (#10615) 2020-09-07 21:22:56 +08:00
fyrestone 47c1a3c0c0 Fix ray.cross_language.java_function() missing accelerator_type arg (#10620) 2020-09-07 20:50:33 +08:00
Alex Wu d6a9f0e2e4 [Core] Accelerator type API (#10561) 2020-09-06 20:58:40 -07:00
Alex Wu a699f6a4d8 [Core] Fix override memory and object_store_memory in decorator (#10563) 2020-09-06 20:56:48 -07:00
Alex Wu 8906c1a59f [Autoscaler] Demand autoscaler take into account utilized resources (#10464) 2020-09-06 20:54:44 -07:00
Kai Fricke c5e9bafe15 [tune] Fix flaky test in test_sample (#10602) 2020-09-06 10:29:48 -07:00
Sven Mika 28ab797cf5 [RLlib] Deprecate old classes, methods, functions, config keys (in prep for RLlib 1.0). (#10544) 2020-09-06 10:58:00 +02:00
Maksim Smolin f38dba09b2 [cli] Support non-interactive logging (#10203)
* add non-interactive logging

* logger

* add formatter support, add flag

* checkpoint

* format

* fix-interactive

* fixup

* fomrmat

* fix

* revert

* fix

* fix

* fix

* fix

* fx

* fix-test

* fix-commands

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-05 15:41:35 -07:00
Richard Liaw 551c597312 [tune] API revamp fix (#10518) 2020-09-05 15:34:53 -07:00
Sven Mika 8a891b3c30 [RLlib] SAC n_step > 1. (#10567) 2020-09-05 22:26:42 +02:00
Stephanie Wang 4f02ad4ef9 [core] Disable GCS reconnect (#10579)
* Set default GCS retries to 1

* Fix cc test
2020-09-05 13:14:07 -07:00
Sumanth Ratna 54215ff287 [tune] implement shim instantiation (#10456)
* Create ray.tune.suggest.create.create_scheduler

* Update __init__.py

* Resolve conflict in __init__.py

* Create ray.tune.schedulers.create.create_scheduler

* Update __init__.py

* Move create_scheduler to tune.schedulers.__init__

* Move create_searcher to tune.suggest.__init__

* Delete tune.suggest.create

* Delete tune.schedulers.create

* Update imports for shim functions in tune.__init__

* Remove shim from tune.suggest.__init__.__all__

* Remove shim from tune.schedulers.__init__.__all__

* Add ShimCreationTest

* Move ShimCreationTest to test_api

* Delete test_shim.py

* Add docstring for ray.tune.create_scheduler

* Add docstring to ray.tune.create_searcher

* Fix typo in ray.tune.create_scheduler docstring

* Fix lint errors in tune.schedulers.__init__

* Fix lint errors in tune.suggest.__init__

* Fix lint errors in tune.suggest.__init__

* Fix lint errors in tune.schedulers.__init__

* Fix imports in test_api

* Fix lint errors in test_api

* Fix kwargs in create_searcher

* Fix kwargs in create_scheduler

* Merge branch 'master' into shim-instantiation

* Update use-case in docs in tune.create_scheduler

* Update use-case in docs in tune.create_searcher

* Remove duplicate pytest run from test_api

* Add check to create_searcher


Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Add check to create_scheduler

* lint

* Compare types of instances in test_api

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Add tune.create_searcher to docs

* Fix doc build

* Fix tests

* Add tune.create_scheduler to docs

* Fix tests

* Fix lint errors

* Update Ax search for master

* Fix metric kwarg for Ax in test_api

* Fix doc build

* Fix HyperOptSearch import in test_api

* Fix HyperOptSearch import in create_searcher

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-05 09:36:42 -07:00
Kai Yang f03e91788a Java doc: "Using Actors" page (#10438) 2020-09-05 23:28:03 +08:00
Hao Chen da8181725d [Java] Fix duplicated isInitialized methods (#10601) 2020-09-05 23:13:53 +08:00