Commit Graph

185 Commits

Author SHA1 Message Date
Philipp Moritz 39ce0eadbe Ray PDB support (#11739) 2020-11-03 09:49:23 -08:00
Maksim Smolin 0a6d24a727 [cli] Remove the deprecated old_style logging calls (#10776)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-11-02 23:40:18 -08:00
Eric Liang 083737c63c Deprecate rsync to all nodes (#11563) 2020-10-22 13:45:42 -07:00
Edward Oakes 5d7f271e7d Add --worker-port-list option to ray start (#11481) 2020-10-21 14:46:45 -05:00
Maksim Smolin 94494c43d6 [cli] Updates (#10777) 2020-09-29 16:55:07 -07:00
Eric Liang 609c1b8acd Start moving ray internal files to _private module (#10994) 2020-09-24 22:46:35 -07:00
Keqiu Hu 46a560e876 [cli][ray] ray start should error by default if there's already an instance running (#10826) 2020-09-24 10:29:59 -05:00
Ian Rodney 4c3f09094a [docs] redis-port -> port (#10937) 2020-09-23 17:04:13 -07:00
Eric Liang 6a227ae501 [autoscaler] Split autoscaler interface public private (#10898) 2020-09-18 18:16:23 -07:00
Alex Wu 9a07c7b963 [1.0] Remove args from ray start (#10659) 2020-09-18 16:41:23 -07:00
Keqiu Hu 8a77cf925a [cli][ray] update ray cli message (#10823) 2020-09-17 09:26:55 -07:00
Siyuan (Ryans) Zhuang fb0ae148e6 Fix typo in ray start output (#10667) 2020-09-10 15:56:23 -07:00
Richard Liaw 7aa55ca82c [autoscaler] make commands very explicit on logs (#10713) 2020-09-10 10:47:46 -07:00
Alex Wu cd5b99e5e0 [hotfix] redis_password -> _redis_password (#10672) 2020-09-09 09:40:49 -07:00
Kai Yang afa0216280 Remove the '--include-java' option (#10594) 2020-09-09 17:01:17 +08:00
chaokunyang bbfbc98a41 [Core] Allow users to specify the classpath and import path (#10560)
* move job resource path to job config

* job resource path support list

* job resource path support for python

* fix job_resource_path support

* fix worker command

* fix job config

* use jar file instead of parent path

* fix job resource path

* add test to test.sh

* lint

* Update java/runtime/src/main/resources/ray.default.conf

Co-authored-by: Kai Yang <kfstorm@outlook.com>

* fix testGetFunctionFromLocalResource

* lint

* fix rebase

* add jars in resource path to classloader

* add job_resource_path to worker

* add ray stop

* rename job_resource_path to resource_path

* fix resource_path

* refine resource_path comments

* rename job resource path to code search path

* Add instruction about starting a cross-language cluster

* fix ClassLoaderTest.java

* add code-search-path to RunManager

* refine comments for code-search-path

* rename resourcePath to codeSearchPath

* Update doc

* fix

* rename resourcePath to codeSearchPath

* update doc

* filter out empty path

* fix comments

* fix comments

* fix tests

* revert pom

* lint

* fix doc

* update doc

* Apply suggestions from code review

* lint

Co-authored-by: Kai Yang <kfstorm@outlook.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-09-09 00:46:32 +08:00
Maksim Smolin f38dba09b2 [cli] Support non-interactive logging (#10203)
* add non-interactive logging

* logger

* add formatter support, add flag

* checkpoint

* format

* fix-interactive

* fixup

* fomrmat

* fix

* revert

* fix

* fix

* fix

* fix

* fx

* fix-test

* fix-commands

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-05 15:41:35 -07:00
Maksim Smolin 02efa2549d [cli] Fix colors on light themes (#10577) 2020-09-04 10:45:27 -07:00
chaokunyang ea95e6f7cc [Java] lint java code (#10494) 2020-09-03 10:39:14 +08:00
Richard Liaw 8c753818ab update-scripts (#10425) 2020-08-29 23:16:25 -07:00
Eric Liang 519354a39a [api] Initial API deprecations for Ray 1.0 (#10325) 2020-08-28 15:03:50 -07:00
Stephanie Wang f75dfd60a3 [api] API deprecations and cleanups for 1.0 (internal_config and Checkpointable actor) (#10333)
* remove

* internal config updates, remove Checkpointable

* Lower object timeout default

* remove json

* Fix flaky test

* Fix unit test
2020-08-27 10:19:53 -07:00
Maksim Smolin 245c0a9e43 [cli] Tests (#10057)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-22 13:29:10 -07:00
Richard Liaw f87669372d [cli] enable log-new-style by default (#10213) 2020-08-21 15:21:43 -07:00
SangBin Cho 92664249e8 Partially Use f string (#10218)
* flynt. trial 1.

* Trial 1.

* Addressed code review.
2020-08-20 18:21:16 -07:00
Max Fitton 8d06e30a06 [Dashboard] Fix Ray Dashboard command error messages (#10050) 2020-08-18 13:30:51 -05:00
Richard Liaw 7a56c3b71a [cli] create_or_update_cluster fix (#10085) 2020-08-13 00:54:45 -07:00
Richard Liaw 5560272556 [cli] install nightly wheels via ray install-nightly (#10054) 2020-08-11 20:08:22 -07:00
Maksim Smolin 40b8e35d61 [cli] New logging for the rest of the ray commands (#9984)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-11 09:58:23 -07:00
Maksim Smolin 0392bb7a72 [Autoscaler] Command Output Improvement (#9699)
* cross-platform prototype

* checkpoint

* Address PR comments

* format

* prepare to push

* format

* PR comments

* fixes

* fixtest

* Revert "fixtest"

This reverts commit d6f54353e1b891c784417bb8d0304c18cc5bcdd8.

* return-result

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-10 09:49:24 -07:00
SangBin Cho 39088ab6f2 [Stats] Metrics Export User Interface Part 2 (Prometheus Service Discovery) (#9970)
* In progress.

* In Progress.

* Finish the working version.

* Write a documentation.

* Addressed code review.

* Fix lint error.

* Lint.

* Addressed code review. Make test less flaky.

* Use a random port for ray start.

* Modify doc.

* Make write atomic.
2020-08-07 21:59:24 -07:00
SangBin Cho ec2f1a225e [Stats] Metrics Export User Interface Part 1 (#9913)
* Metrics export port expose done.

* Support exposing metrics port + metrics agent service discovery through ray.nodes()

* Formatting.

* Added a doc.

* Linting.

* Change the location of metrics agent port.

* Addressed code review.

* Addressed code review.
2020-08-06 16:16:29 -07:00
Maksim Smolin 908c0c630a [Autoscaler] Command Line Interface improvements (#9322)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-07-22 12:21:44 -07:00
jerrylee.io 4c18463fb7 [cli] ray memory: added redis_password (#9492) 2020-07-18 00:08:41 -07:00
Stephanie Wang b351d13940 [core] Add flag to enable object reconstruction during ray start (#9488)
* Add flag

* doc

* Fix tests
2020-07-17 10:13:14 -07:00
SangBin Cho 539c51a003 [Core] Support GCS server port assignment. (#8962) 2020-07-14 11:49:56 -05:00
Ian Rodney 0085cf75d0 Allow --lru-evict to be passed into ray start (#8959) 2020-07-13 14:09:39 -07:00
Patrick Ames dc51b08c36 [autoscaler] Allow users to disable the cluster config cache (#8117)
* [autoscaler] Remove autoscaler config cache.

* [autoscaler] Add flag allowing users to explicitly disable the config cache.
2020-07-09 15:47:58 -07:00
Ian Rodney 079c1eaa5c [autoscaler] Require keyword arguments (#9256) 2020-07-06 22:12:59 -07:00
ChenZhilei c11855728a Remove raylet monitor after use GCS service (#9179) 2020-07-01 20:01:52 +08:00
Richard Liaw 625b66bde7 [docs] Show commands on documentation (#9165) 2020-06-27 12:56:56 -07:00
Ian Rodney 42631c5b87 [autoscaler/docker] Migrate --docker to --run-env (#9001) 2020-06-25 20:37:42 -07:00
Eric Liang 0ff24ec8dc Add "ray status" debug tool for autoscaler. (#9091) 2020-06-24 18:22:03 -07:00
Max Fitton ad09aa985c Make Dashboard Port Configurable (#8999) 2020-06-19 16:26:22 -05:00
Ian Rodney 0e82f0d7c3 [autoscaler] Create Docker Command Runner (v2) (#8840)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-06-12 16:38:38 -07:00
Sumanth Ratna 439dbb7822 [CLI] Add version option (#8886)
Closes https://github.com/ray-project/ray/issues/8878.
2020-06-10 18:12:00 -07:00
mehrdadn 50f6272fcc Replace ps call with psutil (#8851)
* Replace ps call with psutil

* Minor formatting

Co-authored-by: Mehrdad <noreply@github.com>
Co-authored-by: Robert Nishihara <robertnishihara@gmail.com>
2020-06-09 14:21:19 -07:00
Edward Oakes a76434ccde Add ability to specify worker and driver ports (#8071) 2020-05-20 15:31:13 -05:00
Max Fitton 13231ba63b Rename redis-port to port and add default (#8406) 2020-05-18 13:25:34 -05:00
Joseph Lucas 42c9fa19d1 [autoscaler] Ray Up url-arg (#8279) 2020-05-17 12:18:00 -07:00