wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-19 11:27:32 +08:00
Code Issues Packages Projects Releases Wiki Activity
6,359 Commits 36 Branches 42 Tags
8fb926565cbf0cd554bc24ccf1ea3a47dcc41dad
Commit Graph
1586 Commits
Author SHA1 Message Date
Hao ChenandStephanie Wang ea6aa6409a Reconstruct failed actors without sending tasks. (#5161) 
* fast reconstruct dead actors

* add test

* fix typos

* remove debug print

* small fix

* fix typos

* Update test_actor.py
 2019-07-15 10:25:09 -07:00
Hao ChenandGitHub 7342117710 Fix a multithreading bug in grpc ClientCall (#5196) 2019-07-15 14:49:53 +08:00
Philipp MoritzandRobert Nishihara 322b5166ad Update arrow to include user defined status for plasma (#5156) 2019-07-12 22:51:14 -07:00
Hao ChenandQing Wang f5a87b88a3 Fix: ServerCallFactory's destructor not marked as virtual (#5185) 2019-07-13 09:38:47 +08:00
Stephanie WangandHao Chen f46c555e9e Only get actor ID if actor task (#5180) 2019-07-12 14:31:21 +08:00
vipulharshandStephanie Wang 3b42d5ccb1 Track newly created actor's parent actor (#5098) 
* Track parent actor of actor

* Update src/ray/raylet/node_manager.cc

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/raylet/node_manager.cc

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* fixing a comment

* Fixing typo in a comment

* capturing task_spec instead of actor_data

* adding const for some local variables

* changing an if else to else

* Linted version

* use updated method to create task from task_data

Change-Id: I9c1a65134dc23a2d175047e96b86ab9d9cf61971

* fixing linter issues

Change-Id: I1def06218130b399d2527b999258aecf9abb98dd
 2019-07-11 14:52:04 -07:00
Philipp MoritzandStephanie Wang ccee77aafd fix node_failures.py (#5167) 2019-07-11 11:40:13 -07:00
Zhijun FuandStephanie Wang 1649f1370e [direct call] changes raylet to push tasks to worker (#5140) 
* refactor grpc server

* format

* change GetTask() to PushTask()

* change PushTask to AssignTask

* format

* add resource_ids

* move done_callback to server call

* remove SetTaskHandler and initialize it in task receiver's constructor

* format

* resolve comments

* update

* update

* Update src/ray/core_worker/core_worker.cc

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* resolve comments

* format

* Update src/ray/core_worker/transport/raylet_transport.cc

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* resolve comments

* resolve comments

* fix build

* format

* fix

* format

* noop
 2019-07-11 11:01:32 -07:00
Hao ChenandGitHub fd835d107e Move task to common module and add checks in getter methods (#5147) 2019-07-11 17:07:04 +08:00
Qing WangandGitHub f2293243cc [ID Refactor] Shorten the length of JobID to 4 bytes (#5110) 
* WIP

* Fix

* Add jobid test

* Fix

* Add python part

* Fix

* Fix tes

* Remove TODOs

* Fix C++ tests

* Lint

* Fix

* Fix exporting functions in multiple ray.init

* Fix java test

* Fix lint

* Fix linting

* Address comments.

* FIx

* Address and fix linting

* Refine and fix

* Fix

* address

* Address comments.

* Fix linting

* Fix

* Address

* Address comments.

* Address

* Address

* Fix

* Fix

* Fix

* Fix lint

* Fix

* Fix linting

* Address comments.

* Fix linting

* Address comments.

* Fix linting

* address comments.

* Fix
 2019-07-11 14:25:16 +08:00
Kai YangandHao Chen 43b6513d19 [GCS] Move node resource info from client table to resource table (#5050) 2019-07-11 13:17:19 +08:00
Philipp MoritzandStephanie Wang e6a81d40a5 [stability] Make task result for RemoveTask optional (#5146) 
* make task result for RemoveTask optional

* lint

* update

* update

* update

* rename

* lint
 2019-07-10 13:33:41 -07:00
Joey JiangandHao Chen e55c8ca165 Fix crash because of the reference to deleted variable in grpc server call (#5158) 2019-07-10 14:06:21 +08:00
Joey JiangandHao Chen 5733690aa6 Add success and fail callback of grpc sending reply (#5141) 2019-07-09 17:03:57 +08:00
Hao ChenandGitHub 8a30b93e42 Define common data structures with protobuf. (#5121) 2019-07-08 22:41:37 +08:00
Joey JiangandHao Chen 274233962f Remove unused connection file in object manager (#5123) 2019-07-08 10:59:36 +08:00
Philipp MoritzandRobert Nishihara c5253cc300 Add job table to state API (#5076) 2019-07-06 00:05:48 -07:00
Zhijun FuandQing Wang 54d5969cea [grpc] Add grpc server to worker (#5054) 
* refactor grpc server

* format

* change GetTask() to PushTask()

* change PushTask to AssignTask

* format

* update

* fix test

* format

* Update src/ray/rpc/worker_client.h

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update BUILD.bazel

* Update src/ray/core_worker/task_execution.cc

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* update

* format

* address comments

* format

* Update src/ray/rpc/worker/worker_server.h

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/protobuf/worker.proto

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* format

* fix

* format
 2019-07-04 20:16:42 +08:00
Stephanie WangandGitHub 71d4637b75 [core worker] Refactor CoreWorker member classes (#5062) 
* Move store client mutex inside CoreWorkerPlasmaStoreProvider

* Move PlasmaClient inside CoreWorkerStoreProvider

* Remove CoreWorkerObjectInterface's ref to CoreWorker

* Remove WorkerLanguage

* Remove CoreWorkerTaskInterface's ref to CoreWorker

* Remove CoreWorkerTaskExecutionInterface's ref to CoreWorker

* lint

* move comment

* Fix build

* Fix build
 2019-07-02 15:30:30 -07:00
Kai YangandQing Wang 1cf7728f35 [Core worker] Serialize ActorHandle in core worker. Make ActorHandle thread safe. (#5034) 
* Serialize ActorHandle in core worker. Make ActorHandle thread safe.

* Address comments

* Address comments

* Address comments

* Address comments

* lint

* Address comments

* Address comments

* Address comments

* Address comments

* Minor update

* Address comments

* lint
 2019-07-02 16:48:43 +08:00
Qing WangandGitHub 247f95b3ff Refine RegisterClientRequest message to make it clearer. (#5057) 
* transfor driver task id Explicitly

* Refins

* Fix and add comment.

* add more

* Fix

* Fix

* Add comments

* Fix
 2019-07-02 14:26:19 +08:00
Simon MoandQing Wang 6c4c1d444d Update VersionKey in stats (#5070) 2019-06-30 18:23:12 +08:00
Kai YangandPhilipp Moritz 4ccb7b05cc [Core worker] Add metadata support in object interface (#5031) 2019-06-28 11:35:03 -07:00
Hao ChenandGitHub cefbb0c94c Fix driver id in TaskInfo (#5055) 2019-06-28 12:56:48 +08:00
Kai YangandHao Chen a39982e676 [Core worker] Task execution passes TaskInfo struct to executor (#5032) 2019-06-28 10:59:45 +08:00
Joey JiangandHao Chen d6bbbdef35 Use gRPC to handle communication and data transmission between object manager (#4996) 2019-06-28 10:56:34 +08:00
Qing WangandGitHub 62e4b591e3 [ID Refactor] Rename DriverID to JobID (#5004) 
* WIP

WIP

WIP

Rename Driver -> Job

Fix complition

Fix

Rename in Java

In py

WIP

Fix

WIP

Fix

Fix test

Fix

Fix C++ linting

Fix

* Update java/runtime/src/main/java/org/ray/runtime/config/RayConfig.java

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/core_worker/core_worker.cc

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Address comments

* Fix

* Fix CI

* Fix cpp linting

* Fix py lint

* FIx

* Address comments and fix

* Address comments

* Address

* Fix import_threading
 2019-06-28 00:44:51 +08:00
Hao ChenandGitHub 469ae41013 Fix memory leak in rpc ServerCall and ClientCall (#5046) 2019-06-27 13:19:47 +08:00
Stephanie WangandGitHub 1a8d0af814 Remove debug check for uncommitted lineage (#5038) 2019-06-26 11:21:00 -07:00
Zhijun FuandPhilipp Moritz bb8e75b532 [grpc] refactor rpc server to support multiple io services (#5023) 2019-06-25 19:08:09 -07:00
Hao ChenandPhilipp Moritz 0131353d42 [gRPC] Migrate gcs data structures to protobuf (#5024) 2019-06-25 14:31:19 -07:00
Qing WangandGitHub e33d0eac68 Add dynamic worker options for worker command. (#4970) 
* Add fields for fbs

* WIP

* Fix complition errors

* Add java part

* FIx

* Fix

* Fix

* Fix lint

* Refine API

* address comments and add test

* Fix

* Address comment.

* Address comments.

* Fix linting

* Refine

* Fix lint

* WIP: address comment.

* Fix java

* Fix py

* Refin

* Fix

* Fix

* Fix linting

* Fix lint

* Address comments

* WIP

* Fix

* Fix

* minor refine

* Fix lint

* Fix raylet test.

* Fix lint

* Update src/ray/raylet/worker_pool.h

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/runtime/src/main/java/org/ray/runtime/AbstractRayRuntime.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Address comments.

* Address comments.

* Fix test.

* Update src/ray/raylet/worker_pool.h

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Address comments.

* Address comments.

* Fix

* Fix lint

* Fix lint

* Fix

* Address comments.

* Fix linting
 2019-06-23 18:08:33 +08:00
Hao ChenandGitHub 2bf92e02e2 [gRPC] Use gRPC for inter-node-manager communication (#4968) 2019-06-17 19:00:50 +08:00
Qing WangandHao Chen b08765a08b Fix a crash when unknown worker registering to raylet (#4992) 2019-06-17 13:34:23 +08:00
Zhijun FuandHao Chen 37abdb283f [Core worker] add store & task provider (#4966) 2019-06-14 18:35:32 +08:00
Hao ChenandGitHub 3c92b2ee4d Upgrade CI clang-format to 6.0 (#4976) 2019-06-14 14:52:32 +08:00
Stephanie WangandRobert Nishihara 89ca5eeb29 Flush all tasks from local lineage cache after a node failure (#4964) 2019-06-12 11:13:39 -07:00
Zhijun FuandHao Chen 472c36ed1e [core worker] add task submission & execution interface (#4922) 2019-06-12 10:10:12 +08:00
Philipp MoritzandRobert Nishihara ebb3b3b928 [core] Use int64_t instead of int to keep track of fractional resources (#4959) 2019-06-10 23:49:04 -07:00
Philipp MoritzandRobert Nishihara 1e2b649580 Use proper session directory for debug_string.txt (#4960) 2019-06-10 23:46:37 -07:00
Robert NishiharaandPhilipp Moritz a82e8118a0 Fix resource bookkeeping bug with acquiring unknown resource. (#4945) 2019-06-07 21:07:27 -07:00
Stephanie WangandRobert Nishihara 873d45b467 Flush lineage cache on task submission instead of execution (#4942) 2019-06-07 11:35:18 -07:00
Yuhong GuoandHao Chen 5eff47b657 [C++] Add hash table to Redis-Module (#4911) 2019-06-07 16:11:37 +08:00
Robert NishiharaandGitHub c3f8fc1c44 Update version number in documentation after release 0.7.0 -> 0.7.1 and 0.8.0.dev0 -> 0.8.0.dev1. (#4941) 2019-06-06 17:22:45 -07:00
Hao ChenandRobert Nishihara d106283769 Better organize ray_common module (#4898) 2019-06-04 23:19:09 -07:00
Zhijun FuandHao Chen b674c4a5ba [Core Worker] implement ObjectInterface and add test framework (#4899) 2019-06-03 19:59:43 +08:00
Yuhong GuoandHao Chen 0066d7cf2a Hotfix for change of from_random to FromRandom (#4909) 2019-05-31 16:41:31 +08:00
Yuhong GuoandHao Chen 1f0809e2b4 Refactor ID Serial 2: change all ID functions to CamelCase (#4896) 2019-05-31 11:31:18 +08:00
Hao ChenandGitHub 2912a7cb86 Initial high-level code structure of CoreWorker. (#4875) 2019-05-30 02:43:17 -07:00
Qing WangandGitHub b7c284aaa3 Refactor redis callback handling (#4841) 
* Add CallbackReply

* Fix

* fix linting by format.sh

* Fix linting

* Address comments.

* Fix
 2019-05-30 11:54:30 +08:00