74a34b736d
Call ray.put in ray.init() to speed up first object store access. ( #5685 )
2019-09-14 21:27:32 -07:00
a5d7de6aaf
[core worker] Python core worker normal task submission ( #5566 )
2019-09-14 13:02:53 -07:00
4c964c0941
Initial implementation for pickle5 support ( #5611 )
2019-09-13 17:54:14 -07:00
07c4c6367a
[core worker] Python core worker object interface ( #5272 )
2019-09-12 23:07:46 -07:00
ddadc18ef6
Fix bug in ray.errors and update its default behavior ( #5576 )
2019-09-05 13:18:57 -07:00
a101812b9f
Replace --redis-address with --address in test, docs, tune, rllib ( #5602 )
...
* wip
* add tests and tune
* add ci
* test fix
* lint
* fix tests
* wip
* sugar dep
2019-09-01 16:53:02 -07:00
0292f99e6c
Fix DeprecationWarning ( #5608 )
2019-09-01 15:21:32 -07:00
3e70daba74
Warn on resource deadlock; improve object store error messages ( #5555 )
...
* wip
* wip
* wip
* wip
* wip
* add impl
* second
* warn once
2019-08-30 16:45:54 -07:00
bea43c85b1
Ref count objects created with ray.put ( #5590 )
...
* wip
* add weakref option
* tune util
* test ref
* doc
* fix tests
2019-08-30 16:43:23 -07:00
e2e30ca507
Ray, Tune, and RLlib support for memory, object_store_memory options ( #5226 )
2019-08-21 23:01:10 -07:00
df47bdf6c9
Allow address instead of redis_address ( #5412 )
...
* addr
* wip
* fix typo
* add to start
* switch to ray address for train
* say address
* disambiguate help
* comments 2
2019-08-10 00:18:41 -07:00
d372f24e3c
[ID Refactor] Refactor ActorID, TaskID and ObjectID ( #5286 )
...
* Refactor ActorID, TaskID on the Java side.
Left a TODO comment
WIP for ObjectID
ADD test
Fix
Add java part
Fix Java test
Fix
Refine test.
Enable test in CI
* Extra a helper function.
* Resolve TODOs
* Fix Python CI
* Fix Java lint
* Update .travis.yml
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu >
* Address some comments.
Address some comments.
Add id_specification.rst
Reanme id_specification.rst to id_specification.md
typo
Address zhijun's comments.
Fix test
Address comments.
Fix lint
Address comments
* Fix test
* Address comments.
* Fix build error
* Update src/ray/design_docs/id_specification.md
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu >
* Update src/ray/design_docs/id_specification.md
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu >
* Update src/ray/design_docs/id_specification.md
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu >
* Update src/ray/design_docs/id_specification.md
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu >
* Update src/ray/design_docs/id_specification.md
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu >
* Address comments
* Update src/ray/common/id.h
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu >
* Update src/ray/common/id.h
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu >
* Update src/ray/common/id.h
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu >
* Update src/ray/design_docs/id_specification.md
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Update src/ray/design_docs/id_specification.md
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Address comments.
* Address comments.
* Address comments.
* Update C++ part to make sure task id is generated determantic
* WIP
* Fix core worker
* Fix Java part
* Fix comments.
* Add Python side
* Fix python
* Address comments
* Fix linting
* Fix
* Fix C++ linting
* Add JobId() method to TaskID
* Fix linting
* Update src/ray/common/id.h
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Update java/api/src/main/java/org/ray/api/id/TaskId.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Update java/api/src/main/java/org/ray/api/id/TaskId.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Update java/api/src/main/java/org/ray/api/id/ActorId.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Address comments
* Add DriverTaskId embeding job id
* Fix tests
* Add python dor_fake_driver_id
* Address comments and fix linting
* Fix CI
2019-08-07 11:04:51 +08:00
0a3ff489fa
Send raylet error logs through the log monitor ( #5351 )
2019-08-05 23:35:09 -07:00
9c00616cdc
Retry and exception for hang on memory store full ( #5143 )
2019-07-27 01:20:13 -07:00
40395acadf
[gRPC] Migrate raylet client implementation to grpc ( #5120 )
2019-07-25 14:48:56 +08:00
53fb876a5f
Improved KeyboardInterrupt Exception Handling ( #5237 )
2019-07-22 02:29:56 -07:00
e5be5fd46d
Remove dependencies from TaskExecutionSpecification ( #5166 )
2019-07-15 18:15:21 -07:00
322b5166ad
Update arrow to include user defined status for plasma ( #5156 )
2019-07-12 22:51:14 -07:00
fd835d107e
Move task to common module and add checks in getter methods ( #5147 )
2019-07-11 17:07:04 +08:00
f2293243cc
[ID Refactor] Shorten the length of JobID to 4 bytes ( #5110 )
...
* WIP
* Fix
* Add jobid test
* Fix
* Add python part
* Fix
* Fix tes
* Remove TODOs
* Fix C++ tests
* Lint
* Fix
* Fix exporting functions in multiple ray.init
* Fix java test
* Fix lint
* Fix linting
* Address comments.
* FIx
* Address and fix linting
* Refine and fix
* Fix
* address
* Address comments.
* Fix linting
* Fix
* Address
* Address comments.
* Address
* Address
* Fix
* Fix
* Fix
* Fix lint
* Fix
* Fix linting
* Address comments.
* Fix linting
* Address comments.
* Fix linting
* address comments.
* Fix
2019-07-11 14:25:16 +08:00
8a30b93e42
Define common data structures with protobuf. ( #5121 )
2019-07-08 22:41:37 +08:00
8f53364097
Improve local_mode ( #5060 )
2019-07-07 17:10:50 -07:00
62e4b591e3
[ID Refactor] Rename DriverID to JobID ( #5004 )
...
* WIP
WIP
WIP
Rename Driver -> Job
Fix complition
Fix
Rename in Java
In py
WIP
Fix
WIP
Fix
Fix test
Fix
Fix C++ linting
Fix
* Update java/runtime/src/main/java/org/ray/runtime/config/RayConfig.java
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu >
* Update src/ray/core_worker/core_worker.cc
Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu >
* Address comments
* Fix
* Fix CI
* Fix cpp linting
* Fix py lint
* FIx
* Address comments and fix
* Address comments
* Address
* Fix import_threading
2019-06-28 00:44:51 +08:00
0131353d42
[gRPC] Migrate gcs data structures to protobuf ( #5024 )
2019-06-25 14:31:19 -07:00
5eff47b657
[C++] Add hash table to Redis-Module ( #4911 )
2019-06-07 16:11:37 +08:00
d86ee8c83e
fetching objects in parallel in _get_arguments_for_execution ( #4775 )
2019-06-01 23:35:48 -07:00
6703519144
Move global state API out of global_state object. ( #4857 )
2019-05-26 11:27:53 -07:00
1a39fee9c6
Refactor ID Serial 1: Separate ObjectID and TaskID from UniqueID ( #4776 )
...
* Enable BaseId.
* Change TaskID and make python test pass
* Remove unnecessary functions and fix test failure and change TaskID to
16 bytes.
* Java code change draft
* Refine
* Lint
* Update java/api/src/main/java/org/ray/api/id/TaskId.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Update java/api/src/main/java/org/ray/api/id/BaseId.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Update java/api/src/main/java/org/ray/api/id/BaseId.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Update java/api/src/main/java/org/ray/api/id/ObjectId.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Address comment
* Lint
* Fix SINGLE_PROCESS
* Fix comments
* Refine code
* Refine test
* Resolve conflict
2019-05-22 14:46:30 +08:00
bd00735fe8
Fix tempfile issues ( #4605 )
2019-05-05 16:06:15 -07:00
d81e71e297
Enable actor methods to be decorated on the caller side also and get postprocessors. ( #4732 )
...
* Allow decorating ray actor methods.
* Add test.
* Add get postprocessors.
* Improve documentation.
* Make it work for remote functions.
* Temporary fix.
2019-05-04 11:53:47 -07:00
4eade036a0
Separate thread locks for worker and function manager. ( #4499 )
...
* Separate lock for function manager and worker
* Lint
* Add test case
* Remove print in remote function.
* Remove test and add ray.exit_actor
* Update python/ray/worker.py
Co-Authored-By: guoyuhong <guoyuhong1985@outlook.com >
* Move exit_actor from worker.py to actor.py
* Update actor.py
* Update actor.py
2019-04-29 14:55:37 +08:00
9ce3039390
Fix webui api ( #4686 )
...
* fix webui
* Apply suggestions from code review
lint
Co-Authored-By: suquark <suquark@gmail.com >
* add dependencies for this unittest
* move dependencies to the script file
2019-04-27 15:23:56 +08:00
8dfc833a8b
Change all instances of JobID to DriverID. ( #4431 )
2019-04-22 16:28:09 -07:00
0f42f87ebc
Updating zero capacity resource semantics ( #4555 )
2019-04-12 16:53:57 -07:00
e88e706fcc
Enforce quoting style in Travis. ( #4589 )
2019-04-11 14:24:26 -07:00
dab99d26af
Improve code related to node ( #4383 )
...
* Make full use of node
implement local node
fix bugs mentioned in comments
* Add more tests
* Use more specific exception handling
* fix, lint
* fix for py2.x
2019-04-09 17:27:54 +08:00
c2349cf12d
Remove local/global_scheduler from code and doc. ( #4549 )
2019-04-03 17:05:09 -07:00
11580fb7dc
Changes where actor resources are assigned ( #4323 )
2019-03-24 15:49:36 -07:00
d03999d01e
Cross-language invocation Part 1: Java calling Python functions and actors ( #4166 )
2019-03-21 13:34:21 +08:00
c93eb126ec
Allow manually writing to return ObjectIDs from tasks/actor methods ( #3805 )
2019-03-18 19:24:57 -07:00
3b141b26cd
Fix global_state not disconnected after ray.shutdown ( #4354 )
2019-03-18 16:44:49 -07:00
95254b3d71
Remove the old web UI ( #4301 )
2019-03-07 23:15:11 -08:00
fa8c07dd19
Sleep for half a second at exit in order to avoid losing log messages… ( #4254 )
2019-03-04 20:39:09 -08:00
5866fd7005
Add type check in free and change Exception to TypeError ( #4221 )
2019-03-04 16:40:04 +08:00
9950f63e8c
Send task error instead of raw exception for signal ( #4150 )
2019-03-01 23:59:29 -08:00
f21e6a2cff
Update documentation regarding UI and timeline. ( #4189 )
2019-03-01 19:54:33 -08:00
6f1a29ad3f
Consodiate CI Python tests and fix bug about multiple ray.init ( #4195 )
2019-03-01 14:38:28 -08:00
d9bcaa20b5
Turn UI off by default. ( #4188 )
2019-02-28 17:29:52 -08:00
88e14feb53
Reset signal counters when a task finishes ( #4173 )
2019-02-28 15:15:03 -08:00
1f864a02bc
Add option of load_code_from_local which is required in cross-language ray call. ( #3675 )
2019-02-21 12:37:17 +08:00
Robert Nishihara