243f678ffd
Fall back to random port instead of default port for non-primary Redis shards; attempt to cluster Redis shard ports close to each other. ( #13847 )
2021-02-03 22:00:15 -08:00
d1ec787d9d
[Object Spilling] Turn on by default. ( #13745 )
...
* Done.
* in progress.
* in progress.
* fixed tests.
* Fix.
2021-01-31 23:28:37 -08:00
edbb2937d3
[Object Spilling] Multi node file spilling V2. ( #13542 )
...
* done.
* done.
* Fix a mistake.
* Ready.
* Fix issues.
* fix.
* Finished the first round of code review.
* formatting.
* In progress.
* Formatting.
* Addressed code review.
* Formatting
* Fix tests.
* fix bugs.
* Skip flaky tests for now.
2021-01-23 23:15:32 -08:00
99375c4cfc
[Object Spilling] Remove retries and use a timer instead. ( #13175 )
2021-01-19 11:01:45 -08:00
1fbc3ddfac
Add ability to not start Monitor when calling ray start ( #13505 )
2021-01-18 18:31:53 -08:00
9872fc1801
Start ray client server with 'ray start' ( #13217 )
2021-01-06 21:04:14 -08:00
e3b5deb741
[Multi-tenancy] Delete flag enable_multi_tenancy and remove old code path ( #10573 )
2020-12-10 19:01:40 +08:00
0ba777af99
[Object spilling] Add policy to automatically spill objects on OutOfMemory ( #11673 )
2020-11-02 12:42:02 -08:00
71c5089854
[Object Spilling] Initial Iteration of S3 adapter. ( #11379 )
...
* Finished the first iteration.
* Removed unnecessary code.
* Smartopen impl.
* Make sure tests passed.
* Addressed code review.
* Addressed code review.
* Fix issues.
* Fix issues.
2020-10-30 14:47:07 -07:00
5d7f271e7d
Add --worker-port-list option to ray start ( #11481 )
2020-10-21 14:46:45 -05:00
afa0216280
Remove the '--include-java' option ( #10594 )
2020-09-09 17:01:17 +08:00
bbfbc98a41
[Core] Allow users to specify the classpath and import path ( #10560 )
...
* move job resource path to job config
* job resource path support list
* job resource path support for python
* fix job_resource_path support
* fix worker command
* fix job config
* use jar file instead of parent path
* fix job resource path
* add test to test.sh
* lint
* Update java/runtime/src/main/resources/ray.default.conf
Co-authored-by: Kai Yang <kfstorm@outlook.com >
* fix testGetFunctionFromLocalResource
* lint
* fix rebase
* add jars in resource path to classloader
* add job_resource_path to worker
* add ray stop
* rename job_resource_path to resource_path
* fix resource_path
* refine resource_path comments
* rename job resource path to code search path
* Add instruction about starting a cross-language cluster
* fix ClassLoaderTest.java
* add code-search-path to RunManager
* refine comments for code-search-path
* rename resourcePath to codeSearchPath
* Update doc
* fix
* rename resourcePath to codeSearchPath
* update doc
* filter out empty path
* fix comments
* fix comments
* fix tests
* revert pom
* lint
* fix doc
* update doc
* Apply suggestions from code review
* lint
Co-authored-by: Kai Yang <kfstorm@outlook.com >
Co-authored-by: Hao Chen <chenh1024@gmail.com >
2020-09-09 00:46:32 +08:00
f35339b5ff
[Dashboard] Change default ip address for the dashboard to ipv4 ( #10287 )
...
* Done.
* Add todo.
* Addressed code review.
* Fix issue.
* Fix test failure.
* Fix a test.
2020-08-27 14:43:10 -07:00
f75dfd60a3
[api] API deprecations and cleanups for 1.0 (internal_config and Checkpointable actor) ( #10333 )
...
* remove
* internal config updates, remove Checkpointable
* Lower object timeout default
* remove json
* Fix flaky test
* Fix unit test
2020-08-27 10:19:53 -07:00
92664249e8
Partially Use f string ( #10218 )
...
* flynt. trial 1.
* Trial 1.
* Addressed code review.
2020-08-20 18:21:16 -07:00
17ca1d8ff4
[Core] Object spilling prototype ( #9818 )
2020-08-14 15:39:10 -07:00
ec2f1a225e
[Stats] Metrics Export User Interface Part 1 ( #9913 )
...
* Metrics export port expose done.
* Support exposing metrics port + metrics agent service discovery through ray.nodes()
* Formatting.
* Added a doc.
* Linting.
* Change the location of metrics agent port.
* Addressed code review.
* Addressed code review.
2020-08-06 16:16:29 -07:00
27cd323ce1
[Core] Multi-tenancy: Job isolation & implement per job config (except for env variables) ( #9500 )
2020-08-04 15:51:29 +08:00
b351d13940
[core] Add flag to enable object reconstruction during ray start ( #9488 )
...
* Add flag
* doc
* Fix tests
2020-07-17 10:13:14 -07:00
539c51a003
[Core] Support GCS server port assignment. ( #8962 )
2020-07-14 11:49:56 -05:00
f6eb47fc1f
[Stats] metrics agent exporter ( #9361 )
2020-07-14 11:49:16 -05:00
0085cf75d0
Allow --lru-evict to be passed into ray start ( #8959 )
2020-07-13 14:09:39 -07:00
d49dadf891
Change Python's ObjectID to ObjectRef ( #9353 )
2020-07-10 17:49:04 +08:00
ad09aa985c
Make Dashboard Port Configurable ( #8999 )
2020-06-19 16:26:22 -05:00
a76434ccde
Add ability to specify worker and driver ports ( #8071 )
2020-05-20 15:31:13 -05:00
90ef585fd5
Revert "Add ability to specify worker and driver ports ( #7833 )" ( #8069 )
...
This reverts commit 9f751ff8c4
2020-04-17 12:32:22 -05:00
9f751ff8c4
Add ability to specify worker and driver ports ( #7833 )
2020-04-16 13:49:25 -05:00
d4cae5f632
[Core] Added ability to specify different IP addresses for a core worker and its raylet. ( #7985 )
2020-04-16 10:32:24 -05:00
9bfc2c4b54
Moving Local Mode to C++ ( #7670 )
2020-04-01 15:50:57 -05:00
2b80310e6f
Remove setup.py dependence on packaging. ( #7714 )
2020-03-23 16:21:17 -07:00
4ab80eafb9
Deprecate use_pickle flag ( #7474 )
2020-03-09 16:03:56 -07:00
a8bda9b551
Fix incorrect handling of command-lines ( #7439 )
2020-03-06 15:51:49 -08:00
60d4d5e1aa
Remove future imports ( #6724 )
...
* Remove all __future__ imports from RLlib.
* Remove (object) again from tf_run_builder.py::TFRunBuilder.
* Fix 2xLINT warnings.
* Fix broken appo_policy import (must be appo_tf_policy)
* Remove future imports from all other ray files (not just RLlib).
* Remove future imports from all other ray files (not just RLlib).
* Remove future import blocks that contain `unicode_literals` as well.
Revert appo_tf_policy.py to appo_policy.py (belongs to another PR).
* Add two empty lines before Schedule class.
* Put back __future__ imports into determine_tests_to_run.py. Fails otherwise on a py2/print related error.
2020-01-09 00:15:48 -08:00
39a3459886
Remove (object) from class declarations. ( #6658 )
2020-01-02 17:42:13 -08:00
e2bc489a18
Port webui nits from original pr that enables it ( #6628 )
...
* backport changes
* Update test_webui.py
2019-12-29 19:19:43 -08:00
8724e5ffd5
Start WebUI by default. ( #6493 )
2019-12-27 13:49:07 -08:00
e530c37b0e
Use localhost and set redis password by default ( #6481 )
2019-12-17 19:41:19 -08:00
afae8406da
Make sure numpy >= 1.16.0 is installed for fast pickling support ( #6486 )
...
* Make sure numpy >= 1.16.0 is installed
* Works for 1.15.4
* lint
* formatting
* update
* put check into the right place
* lint
2019-12-14 16:36:49 -08:00
f24d96ec4f
Revert "Try to enable dashboard (again) ( #6069 )" ( #6159 )
...
This reverts commit 4044af8520
2019-11-13 12:32:12 -08:00
4044af8520
Try to enable dashboard (again) ( #6069 )
...
* Revert "Revert "Enable the Ray dashboard by default (#5976 )" (#6068 )"
This reverts commit 1a3e97cf23
2019-11-08 10:48:48 -08:00
1a3e97cf23
Revert "Enable the Ray dashboard by default ( #5976 )" ( #6068 )
...
This reverts commit 6166ef3e09
2019-11-01 17:08:37 -07:00
6166ef3e09
Enable the Ray dashboard by default ( #5976 )
2019-11-01 12:19:01 -07:00
235dec8aa3
[Dashboard] Remove token authentication from dashboard ( #5888 )
2019-10-21 12:48:48 -07:00
d23696de17
Introduce flag to use pickle for serialization ( #5805 )
2019-10-18 22:29:36 -07:00
e2e30ca507
Ray, Tune, and RLlib support for memory, object_store_memory options ( #5226 )
2019-08-21 23:01:10 -07:00
c2349cf12d
Remove local/global_scheduler from code and doc. ( #4549 )
2019-04-03 17:05:09 -07:00
95254b3d71
Remove the old web UI ( #4301 )
2019-03-07 23:15:11 -08:00
db5c3b22b7
Fix the issue about starting cross-lang cluster ( #4176 )
2019-02-27 20:11:58 +08:00
1f864a02bc
Add option of load_code_from_local which is required in cross-language ray call. ( #3675 )
2019-02-21 12:37:17 +08:00
5f71751891
API cleanups. Remove worker argument. Remove some deprecated arguments. ( #4025 )
...
* Remove worker argument from API methods.
* Remove deprecated arguments and deprecate redirect_output and redirect_worker_output.
* Fix
2019-02-15 10:49:16 -08:00
Clark Zinzow