8730996682
Windows changes ( #7315 )
2020-02-27 15:14:10 -08:00
c6f50ecc51
setpgrp fix ( #7250 )
2020-02-21 13:15:11 -08:00
b804d40c04
Stop vendoring pyarrow ( #7233 )
2020-02-19 19:01:26 -08:00
7bef7031c2
Revert "Revert "Revert "Removing Pyarrow dependency ( #7146 )" ( #7209 ) ( #7214 )" ( #7232 )
2020-02-19 13:35:29 -08:00
e8941b1b79
Revert "Revert "Removing Pyarrow dependency ( #7146 )" ( #7209 ) ( #7214 )
2020-02-19 10:08:52 -08:00
0aa9373d62
Revert "Removing Pyarrow dependency ( #7146 )" ( #7209 )
...
This reverts commit 2116fd3bca
2020-02-18 14:12:06 -08:00
2116fd3bca
Removing Pyarrow dependency ( #7146 )
2020-02-17 18:00:13 -08:00
94a286ef1d
[Java] Add session_dir as temp_dir for logs, socket files like Python ( #7044 )
...
* Support
* Add gcs_server support
* Fix ut
* Fix
* Remove unused py code
* Fix linting
* Fix cross language ci
* Fix CI
* Add docstring
* Fix
* Fix linting
* Add a singleton for config
* Refine
* fix
* Fix
* linting
* Remove FileUnit
* Fix
* Fix
* Fix
* Update java/runtime/src/main/java/org/ray/runtime/config/RayConfig.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Fix streaming singleprocess CI
* Fix checkstyle
Co-authored-by: Hao Chen <chenh1024@gmail.com >
2020-02-13 17:49:52 +08:00
694c0f2867
[Java] Enable GCS server when running java unit tests ( #7041 )
...
* enable gcs service when run java testcase
* fix ci bug
* fix windows compile bug
* fix ci bug
* restart ci job
* enable java testcase
* restart ci job
* restart ci job
* add debug log
* add debug log
* restart ci job
* add debug log
* restart ci
* add debug log
* fix java testcase bug
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
2020-02-10 09:39:14 +08:00
0826f95e1c
Including psutil & setproctitle ( #7031 )
2020-02-05 14:16:58 -08:00
4097d076d4
Package ray java jars into wheels ( #6600 )
2020-01-10 11:41:00 +08:00
60d4d5e1aa
Remove future imports ( #6724 )
...
* Remove all __future__ imports from RLlib.
* Remove (object) again from tf_run_builder.py::TFRunBuilder.
* Fix 2xLINT warnings.
* Fix broken appo_policy import (must be appo_tf_policy)
* Remove future imports from all other ray files (not just RLlib).
* Remove future imports from all other ray files (not just RLlib).
* Remove future import blocks that contain `unicode_literals` as well.
Revert appo_tf_policy.py to appo_policy.py (belongs to another PR).
* Add two empty lines before Schedule class.
* Put back __future__ imports into determine_tests_to_run.py. Fails otherwise on a py2/print related error.
2020-01-09 00:15:48 -08:00
ca876c1ecb
Make sure dashboard link can be clicked directly. ( #6683 )
2020-01-03 16:17:16 -08:00
480206eef8
Remove some Python 2 compatibility code. ( #6624 )
2019-12-31 17:14:58 -08:00
e2bc489a18
Port webui nits from original pr that enables it ( #6628 )
...
* backport changes
* Update test_webui.py
2019-12-29 19:19:43 -08:00
8724e5ffd5
Start WebUI by default. ( #6493 )
2019-12-27 13:49:07 -08:00
b7d23405fe
[Dashboard] Change default port from 8080 to 8265 ( #6503 )
...
* [Dashboard] Change default port from 8080 to 8265
* Revise order of imports in pip install setup command
2019-12-16 14:25:23 -08:00
240e8f5279
Fix error message when failing to start UI if grpcio not installed. ( #6433 )
2019-12-11 14:56:13 -08:00
044527adb8
Remove ref counting dependencies on ray.get() ( #6412 )
...
* Remove ref counting dependencies on Get()
* comment
* don't send IDs when disabled
* pass through internal config
* fix
* allow reinit
* remove flag
2019-12-10 18:11:34 -08:00
b88b8202cc
fix java build failure ( #6062 )
2019-12-06 14:38:43 +08:00
e4f9b3b7d9
Use process reaper for cleanup ( #6253 )
2019-11-26 22:00:08 -06:00
f24d96ec4f
Revert "Try to enable dashboard (again) ( #6069 )" ( #6159 )
...
This reverts commit 4044af8520
2019-11-13 12:32:12 -08:00
35d177f459
Use grpc for communication from worker to local raylet (task submission and direct actor args only) ( #6118 )
...
* Skeleton for SubmitTask proto
* Pass through node manager port, connect in raylet client
* Switch submit task to grpc
* Check port in use
* doc
* Remove default port, set port randomly from driver
* update
* Fix test
* Fix object manager test
2019-11-11 21:17:25 -08:00
4044af8520
Try to enable dashboard (again) ( #6069 )
...
* Revert "Revert "Enable the Ray dashboard by default (#5976 )" (#6068 )"
This reverts commit 1a3e97cf23
2019-11-08 10:48:48 -08:00
1a3e97cf23
Revert "Enable the Ray dashboard by default ( #5976 )" ( #6068 )
...
This reverts commit 6166ef3e09
2019-11-01 17:08:37 -07:00
6166ef3e09
Enable the Ray dashboard by default ( #5976 )
2019-11-01 12:19:01 -07:00
f8a6ed7832
Spawn processes in background sessions ( #6008 )
...
Allows us to properly handle KeyboardInterrupts in interactive python interpreters.
2019-10-25 13:01:35 -07:00
235dec8aa3
[Dashboard] Remove token authentication from dashboard ( #5888 )
2019-10-21 12:48:48 -07:00
d23696de17
Introduce flag to use pickle for serialization ( #5805 )
2019-10-18 22:29:36 -07:00
62bc30c1cf
Validate redis address parameters ( #5746 )
...
* Validate redis address params
* Fix comment
* Add check
2019-09-23 10:52:34 -05:00
98dcc1d440
[Dashboard] Add initial version of new dashboard ( #5730 )
2019-09-23 08:50:40 -07:00
ee5db5b67f
Raise error if space in redis password ( #5673 )
2019-09-11 20:58:39 -07:00
732336fc4f
[Java] Support multiple workers in Java worker process ( #5505 )
2019-09-07 22:52:05 +08:00
d20696300e
Fix autoscaler format string for memory ( #5542 )
...
* add format string
* fix cast
2019-08-26 23:25:11 -07:00
e2e30ca507
Ray, Tune, and RLlib support for memory, object_store_memory options ( #5226 )
2019-08-21 23:01:10 -07:00
df47bdf6c9
Allow address instead of redis_address ( #5412 )
...
* addr
* wip
* fix typo
* add to start
* switch to ray address for train
* say address
* disambiguate help
* comments 2
2019-08-10 00:18:41 -07:00
955154a19d
Reduce Ray / RLlib startup messages ( #5368 )
2019-08-05 13:23:54 -07:00
f2293243cc
[ID Refactor] Shorten the length of JobID to 4 bytes ( #5110 )
...
* WIP
* Fix
* Add jobid test
* Fix
* Add python part
* Fix
* Fix tes
* Remove TODOs
* Fix C++ tests
* Lint
* Fix
* Fix exporting functions in multiple ray.init
* Fix java test
* Fix lint
* Fix linting
* Address comments.
* FIx
* Address and fix linting
* Refine and fix
* Fix
* address
* Address comments.
* Fix linting
* Fix
* Address
* Address comments.
* Address
* Address
* Fix
* Fix
* Fix
* Fix lint
* Fix
* Fix linting
* Address comments.
* Fix linting
* Address comments.
* Fix linting
* address comments.
* Fix
2019-07-11 14:25:16 +08:00
5aec750107
Add warning/error if object store memory exceeds available memory ( #4893 )
...
* exclude
* format
* add warning
* hatch
* reduce mem usage
* reduce object store mem
* set obj mem
2019-07-08 21:37:08 -07:00
e33d0eac68
Add dynamic worker options for worker command. ( #4970 )
...
* Add fields for fbs
* WIP
* Fix complition errors
* Add java part
* FIx
* Fix
* Fix
* Fix lint
* Refine API
* address comments and add test
* Fix
* Address comment.
* Address comments.
* Fix linting
* Refine
* Fix lint
* WIP: address comment.
* Fix java
* Fix py
* Refin
* Fix
* Fix
* Fix linting
* Fix lint
* Address comments
* WIP
* Fix
* Fix
* minor refine
* Fix lint
* Fix raylet test.
* Fix lint
* Update src/ray/raylet/worker_pool.h
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Update java/runtime/src/main/java/org/ray/runtime/AbstractRayRuntime.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Address comments.
* Address comments.
* Fix test.
* Update src/ray/raylet/worker_pool.h
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Address comments.
* Address comments.
* Fix
* Fix lint
* Fix lint
* Fix
* Address comments.
* Fix linting
2019-06-23 18:08:33 +08:00
1e2b649580
Use proper session directory for debug_string.txt ( #4960 )
2019-06-10 23:46:37 -07:00
4e0be8b450
Drop duplicated string format ( #4897 )
...
This string format is unnecessary. java_worker_options has been appended to the commandline later.
2019-05-30 19:43:27 +08:00
6703519144
Move global state API out of global_state object. ( #4857 )
2019-05-26 11:27:53 -07:00
259cdfa0de
Fix issue when starting raylet_monitor ( #4829 )
2019-05-22 11:08:24 +08:00
dcd6d4949c
Fix Java worker log dir ( #4781 )
2019-05-17 16:13:28 +08:00
f39b6747e5
Refactor command line argument parsing with gflags ( #4676 )
2019-04-24 14:53:07 +08:00
3e1adafbce
[autoscaler] Add an aggressive_autoscaling flag ( #4285 )
2019-04-13 18:44:32 -07:00
0f42f87ebc
Updating zero capacity resource semantics ( #4555 )
2019-04-12 16:53:57 -07:00
dab99d26af
Improve code related to node ( #4383 )
...
* Make full use of node
implement local node
fix bugs mentioned in comments
* Add more tests
* Use more specific exception handling
* fix, lint
* fix for py2.x
2019-04-09 17:27:54 +08:00
c2349cf12d
Remove local/global_scheduler from code and doc. ( #4549 )
2019-04-03 17:05:09 -07:00
mehrdadn