Commit Graph

860 Commits

Author SHA1 Message Date
Michael Luo 8e613652af [RLLib] MBMPO Fixes (#10296) 2020-09-09 09:34:34 +02:00
Kai Fricke d7c7aba99c [tune] Tune experiment analysis improvements (#10645)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 21:00:52 -07:00
Kai Fricke 756a9ea641 [tune] add mode/metric parameters to tune.run (#10627)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 17:06:21 -07:00
Richard Liaw edce7a05e6 [docs] fix warning -> tip (#10661)
Co-authored-by: simon-mo <simon.mo@hey.com>
2020-09-08 17:00:09 -07:00
Simon Mo 5a38a76c83 [Doc] Use sphinx_book_theme (#10379) 2020-09-08 16:25:23 -07:00
Amog Kamsetty 415be78cc0 [RaySGD] Simplify Builder Process (#10321)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 15:19:40 -07:00
Clark Zinzow 36e1f20e9c Add Dask-Ray scheduler callbacks. (#10519)
Improve Dask-on-Ray documentation.

Move to RayCallback(s) namedtuples, and use top-level CBS tuple as source-of-truth for callback methods.
2020-09-08 13:00:58 -07:00
Simon Mo fdd3acd492 Promote ray.experimental.queue to ray.util (#10624) 2020-09-08 12:56:53 -07:00
chaokunyang bbfbc98a41 [Core] Allow users to specify the classpath and import path (#10560)
* move job resource path to job config

* job resource path support list

* job resource path support for python

* fix job_resource_path support

* fix worker command

* fix job config

* use jar file instead of parent path

* fix job resource path

* add test to test.sh

* lint

* Update java/runtime/src/main/resources/ray.default.conf

Co-authored-by: Kai Yang <kfstorm@outlook.com>

* fix testGetFunctionFromLocalResource

* lint

* fix rebase

* add jars in resource path to classloader

* add job_resource_path to worker

* add ray stop

* rename job_resource_path to resource_path

* fix resource_path

* refine resource_path comments

* rename job resource path to code search path

* Add instruction about starting a cross-language cluster

* fix ClassLoaderTest.java

* add code-search-path to RunManager

* refine comments for code-search-path

* rename resourcePath to codeSearchPath

* Update doc

* fix

* rename resourcePath to codeSearchPath

* update doc

* filter out empty path

* fix comments

* fix comments

* fix tests

* revert pom

* lint

* fix doc

* update doc

* Apply suggestions from code review

* lint

Co-authored-by: Kai Yang <kfstorm@outlook.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-09-09 00:46:32 +08:00
Hao Chen f9098fe631 [Java doc] index and introduction page (#10646) 2020-09-08 22:00:46 +08:00
fyrestone d2614d222c [Doc] Cross language page (#10471) 2020-09-08 16:51:40 +08:00
Kai Fricke 088f8ebb69 [tune] Add algorithms for search space conversion (#10621) 2020-09-07 13:44:16 -07:00
Alex Wu d6a9f0e2e4 [Core] Accelerator type API (#10561) 2020-09-06 20:58:40 -07:00
Richard Liaw 551c597312 [tune] API revamp fix (#10518) 2020-09-05 15:34:53 -07:00
Sumanth Ratna 54215ff287 [tune] implement shim instantiation (#10456)
* Create ray.tune.suggest.create.create_scheduler

* Update __init__.py

* Resolve conflict in __init__.py

* Create ray.tune.schedulers.create.create_scheduler

* Update __init__.py

* Move create_scheduler to tune.schedulers.__init__

* Move create_searcher to tune.suggest.__init__

* Delete tune.suggest.create

* Delete tune.schedulers.create

* Update imports for shim functions in tune.__init__

* Remove shim from tune.suggest.__init__.__all__

* Remove shim from tune.schedulers.__init__.__all__

* Add ShimCreationTest

* Move ShimCreationTest to test_api

* Delete test_shim.py

* Add docstring for ray.tune.create_scheduler

* Add docstring to ray.tune.create_searcher

* Fix typo in ray.tune.create_scheduler docstring

* Fix lint errors in tune.schedulers.__init__

* Fix lint errors in tune.suggest.__init__

* Fix lint errors in tune.suggest.__init__

* Fix lint errors in tune.schedulers.__init__

* Fix imports in test_api

* Fix lint errors in test_api

* Fix kwargs in create_searcher

* Fix kwargs in create_scheduler

* Merge branch 'master' into shim-instantiation

* Update use-case in docs in tune.create_scheduler

* Update use-case in docs in tune.create_searcher

* Remove duplicate pytest run from test_api

* Add check to create_searcher


Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Add check to create_scheduler

* lint

* Compare types of instances in test_api

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Add tune.create_searcher to docs

* Fix doc build

* Fix tests

* Add tune.create_scheduler to docs

* Fix tests

* Fix lint errors

* Update Ax search for master

* Fix metric kwarg for Ax in test_api

* Fix doc build

* Fix HyperOptSearch import in test_api

* Fix HyperOptSearch import in create_searcher

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-05 09:36:42 -07:00
Kai Yang f03e91788a Java doc: "Using Actors" page (#10438) 2020-09-05 23:28:03 +08:00
Richard Liaw 4d4b262069 [docs] Tips for first-time users (copy from blog) (#10578)
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-04 21:44:22 -07:00
Kai Yang 6a78ba9752 Java doc: "Starting Ray" page (#10062) 2020-09-05 10:15:52 +08:00
Kai Fricke 2fac66650d [tune] extend search space api docs (#10576)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-04 18:39:51 -07:00
Eric Liang 2e5e9b291b [ray 1.0] Make private a few more things (#10551)
* reomve some more stuff

* no underscore
2020-09-04 17:19:27 -07:00
Edward Oakes 34bda32054 [tune/serve] Fix tune/serve integration script broken by serve API change (#10586) 2020-09-04 17:11:58 -07:00
Simon Mo 40cd572d79 [Doc] Add a section for synchronization primitives in Ray (#10581)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-04 17:09:15 -07:00
Simon Mo 55b6c19d98 [Serve] Implement ServeHandle refactoring (#10527) 2020-09-04 15:50:56 -07:00
Eric Liang 30911960c8 [1.0] Simple, universal instead of Simple and universal (#10587) 2020-09-04 14:04:29 -07:00
Eric Liang da83bbd764 [1.0] Move dask scheduler from experimental to util (#10553)
* move dask

* fix dask
2020-09-04 12:16:32 -07:00
Edward Oakes 786f12edfd [serve] Serve client refactor (#10409) 2020-09-04 12:02:23 -05:00
Justin Terry 352718610d Multi-agent Algorithm Documentation Updates (#9722) 2020-09-03 22:37:46 -07:00
Kai Fricke 5c3d4a6670 [tune] added MXNet integration callbacks (#10533) 2020-09-03 18:06:44 -07:00
Simon Mo eff4375c3d [Serve] Produtionize Starlette Middlewares (#10529) 2020-09-03 17:31:38 -07:00
architkulkarni 0d93e92720 [Serve] Reimplement BackendConfig as pydantic model (#10389) 2020-09-03 19:16:17 -05:00
Richard Liaw 43a7a64b30 [tune] horovod trainable (#10304) 2020-09-03 16:53:35 -07:00
Sumanth Ratna 89bf262130 [tune] Fix lr typo in FAQ (#10548) 2020-09-03 13:37:39 -07:00
Clark Zinzow 0c0b0d0a73 [Core] Added support for submission-time task names. (#10449)
* Added support for submission-time task names.

* Suggestions from code review: add missing consts

Co-authored-by: SangBin Cho <rkooo567@gmail.com>

* Add num_returns arg to actor method options docstring example.

* Add process name line and proctitle assertion to submission-time task name section of advanced docs.

* Add submission-time task name --> proctitle test for Python worker.

* Added Python actor options tests for num_returns and name.

* Added Java test for submission-time task names.

* Add dashboard image to task name docs section.

* Move to fstrings.

Co-authored-by: SangBin Cho <rkooo567@gmail.com>
2020-09-03 11:45:24 -07:00
krfricke 91535e9102 [tune] Refactored Keras integration callbacks (#10509) 2020-09-03 10:16:08 -07:00
He Kaisheng 2bca5fd663 Add documentation for Mars on Ray (#10468)
* Add documentation for Mars on Ray

* Update mars_on_ray.rst

* refine according to comments

Co-authored-by: hekaisheng <kaisheng.hks@alibaba-inc.com>
Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-09-03 09:07:33 -07:00
krfricke 06af62ba91 [tune] refactor tune search space (#10444)
* Added basic functionality and tests

* Feature parity with old tune search space config

* Convert Optuna search spaces

* Introduced quantized values

* Updated Optuna resolving

* Added HyperOpt search space conversion

* Convert search spaces to AxSearch

* Convert search spaces to BayesOpt

* Added basic functionality and tests

* Feature parity with old tune search space config

* Convert Optuna search spaces

* Introduced quantized values

* Updated Optuna resolving

* Added HyperOpt search space conversion

* Convert search spaces to AxSearch

* Convert search spaces to BayesOpt

* Re-factored samplers into domain classes

* Re-added base classes

* Re-factored into list comprehensions

* Added `from_config` classmethod for config conversion

* Applied suggestions from code review

* Removed truncated normal distribution

* Set search properties in tune.run

* Added test for tune.run search properties

* Move sampler initializers to base classes

* Add tune API sampling test, fixed includes, fixed resampling bug

* Add to API docs

* Fix docs

* Update metric and mode only when set. Set default metric and mode to experiment analysis object.

* Fix experiment analysis tests

* Raise error when delimiter is used in the config keys

* Added randint/qrandint to API docs, added additional check in tune.run

* Fix tests

* Fix linting error

* Applied suggestions from code review. Re-aded tune.function for the time being

* Fix sampling tests

* Fix experiment analysis tests

* Fix tests and linting error

* Removed unnecessary default_config attribute from OptunaSearch

* Revert to set AxSearch default metric

* fix-min-max

* fix

* nits

* Added function check, enhanced loguniform error message

* fix-print

* fix

* fix

* Raise if unresolved values are in config and search space is already set

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-03 09:06:13 -07:00
Ian Rodney b9633a2b67 [docker] Support multiple node types (#10504) 2020-09-02 18:27:59 -07:00
krfricke 57c4183724 [tune] add xgboost callbacks to integration module (#10502) 2020-09-02 11:16:09 -07:00
architkulkarni 6dbba847a1 [Docs] update instructions for building docs (#10480) 2020-09-01 14:17:20 -07:00
Richard Liaw 3f98a8bfcb [docs] Fix warnings for sphinx 1.8 (#10476)
* fix-build-for-sphinx18

* jnilit
2020-09-01 13:37:35 -07:00
Eric Liang e5d089384b [1.0] Ray whitepaper link and tagline update (#10455) 2020-09-01 09:48:35 -07:00
Stephanie Wang 9c2c952262 Add documentation for Dask-on-Ray (#10452)
* Dask on ray

* Dask on ray

* line

* Add links
2020-09-01 08:13:04 -07:00
krfricke f3f698816d [tune] Added PyTorch Lightning callbacks to integrations (#10220)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-31 15:30:48 -07:00
Ian Rodney 5d4d67c47d [docker] Mirror Functionality of CI scripts & Fix docs (#10349)
* first-pass

* add back build examples

* remove unnecessary test

* add gcc and more formatting

* doc fixing

* small fixes
2020-08-31 10:57:17 -07:00
Eric Liang c14b44a292 [api] Remove legacy memory management docs (#10406) 2020-08-28 20:00:58 -07:00
Eric Liang f6a1698bab [autoscaler] Add documentation for multi node type autoscaling (#10405) 2020-08-28 19:57:21 -07:00
Eric Liang 2a204260a8 [api] Second round of 1.0 API changes: exceptions, num_return_vals (#10377) 2020-08-28 19:57:02 -07:00
Eric Liang 519354a39a [api] Initial API deprecations for Ray 1.0 (#10325) 2020-08-28 15:03:50 -07:00
Edward Oakes 94a069e575 Fix docs - atexit is not called when you ray.kill() an actor (#10367) 2020-08-28 13:51:10 -05:00
Eric Liang bd245a1c18 [api] Clean up and document Actor name / lifetime API (#10332) 2020-08-27 13:38:39 -07:00