wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-19 11:27:32 +08:00
Code Issues Packages Projects Releases Wiki Activity
6,359 Commits 36 Branches 42 Tags
8fb926565cbf0cd554bc24ccf1ea3a47dcc41dad
Commit Graph
1586 Commits
Author SHA1 Message Date
Eric LiangandGitHub 2fdefe19b7 Take into account queue length in autoscaling (#5684) 2019-09-11 11:31:35 -07:00
Kai YangandHao Chen ed761900f6 [Java] Support direct actor call in Java worker (#5504) 2019-09-09 14:29:20 +08:00
Kai YangandHao Chen d8f5804690 Support metadata for passing by value task arguments (#5527) 2019-09-08 11:07:48 +08:00
Kai YangandHao Chen 732336fc4f [Java] Support multiple workers in Java worker process (#5505) 2019-09-07 22:52:05 +08:00
Edward OakesandPhilipp Moritz f38bb288e2 Clean up Wait() in the core worker (#5628) 2019-09-04 21:31:34 -07:00
Zhijun FuandHao Chen bb5609afb3 ignore object exists error for memory store provider (#5607) 2019-09-05 11:45:35 +08:00
micafanandQing Wang 8236936189 Fix code style in unit test of GCS. (#5634) 2019-09-04 19:36:44 +07:00
Edward OakesandPhilipp Moritz 0c68b4cc30 Clean up Wait() and Get() in the core worker (#5556) 2019-09-03 14:45:15 -07:00
micafanandHao Chen 378757eb88 fix CallbackReply resize (#5589) 2019-09-03 13:48:18 +08:00
Eric LiangandGitHub 3e70daba74 Warn on resource deadlock; improve object store error messages (#5555) 
* wip

* wip

* wip

* wip

* wip

* add impl

* second

* warn once
 2019-08-30 16:45:54 -07:00
Philipp MoritzandRobert Nishihara 85a92bcb8b Bump version string to 0.8.0.dev4 (#5523) 2019-08-29 21:25:28 -07:00
Philipp MoritzandGitHub e9d2d0432a Make RAY_CHECK for actor re-creation non-fatal (#5553) 2019-08-28 21:07:52 -07:00
Kai YangandHao Chen fadfa5f30b [Java] ObjectID::fromRandom sets proper flags (#5548) 2019-08-28 11:31:06 +08:00
Philipp MoritzandGitHub dbf7089c79 Bump version to 0.7.4 (#5474) 2019-08-23 17:08:16 -07:00
Kai YangandHao Chen 7812dd5636 [Java] Fix getCurrentActorId in multi-threading scenario. (#5506) 2019-08-23 17:56:10 +08:00
Edward OakesandPhilipp Moritz f359333933 Batch fetch requests in core worker get (#5342) 2019-08-22 11:16:46 -07:00
Eric LiangandRobert Nishihara e2e30ca507 Ray, Tune, and RLlib support for memory, object_store_memory options (#5226) 2019-08-21 23:01:10 -07:00
Zhijun FuandHao Chen eab595777f Support multiple store providers in ObjectInterface (#5452) 2019-08-21 11:16:48 +08:00
micafanandHao Chen 52a7c1d673 modify ActorStateAccessor::AsyncGet callback (#5417) 2019-08-21 10:54:33 +08:00
Hao ChenandPhilipp Moritz f2b3c273db Fix direct actor transport not treating some tasks as failed (#5464) 2019-08-20 12:44:38 -07:00
micafanandHao Chen da7bdacea5 support for subscription to an actor (#5269) 2019-08-20 20:32:53 +08:00
Philipp MoritzandGitHub 599cc2be60 Revert raylet to worker GRPC communication back to asio (#5450) 2019-08-17 19:11:32 -07:00
micafanandHao Chen 47aa2b110d Make GCS Client thread-safe. (#5413) 2019-08-17 17:21:09 +08:00
Kai YangandHao Chen b1aae0e398 [Java worker] Migrate task execution and submission on top of core worker (#5370) 2019-08-16 13:52:13 +08:00
Zhijun FuandHao Chen b1e010feec Fix TestDirectActorTaskCrossNodesFailure test (#5406) 2019-08-11 11:15:52 +08:00
Philipp MoritzandGitHub 8d6c50c821 Fix compiler warnings and make warnings fatal (#5375) 2019-08-07 14:04:05 -07:00
Qing WangandGitHub d372f24e3c [ID Refactor] Refactor ActorID, TaskID and ObjectID (#5286) 
* Refactor ActorID, TaskID on the Java side.

Left a TODO comment

WIP for ObjectID

ADD test

Fix

Add java part

Fix Java test

Fix

Refine test.

Enable test in CI

* Extra a helper function.

* Resolve TODOs

* Fix Python CI

* Fix Java lint

* Update .travis.yml

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Address some comments.

Address some comments.

Add id_specification.rst

Reanme id_specification.rst to id_specification.md

typo

Address zhijun's comments.

Fix test

Address comments.

Fix lint

Address comments

* Fix test

* Address comments.

* Fix build error

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Address comments

* Update src/ray/common/id.h

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/common/id.h

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/common/id.h

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Address comments.

* Address comments.

* Address comments.

* Update C++ part to make sure task id is generated determantic

* WIP

* Fix core worker

* Fix Java part

* Fix comments.

* Add Python side

* Fix python

* Address comments

* Fix linting

* Fix

* Fix C++ linting

* Add JobId() method to TaskID

* Fix linting

* Update src/ray/common/id.h

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/api/src/main/java/org/ray/api/id/TaskId.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/api/src/main/java/org/ray/api/id/TaskId.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/api/src/main/java/org/ray/api/id/ActorId.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Address comments

* Add DriverTaskId embeding job id

* Fix tests

* Add python dor_fake_driver_id

* Address comments and fix linting

* Fix CI
 2019-08-07 11:04:51 +08:00
Hao ChenandPhilipp Moritz 3ad2fe76e0 Cap concurrent requests (#5341) 2019-08-06 13:56:19 -07:00
Joey JiangandHao Chen 02c5d2be20 Add common preprocessing for each request in node manager. (#5296) 2019-08-06 20:48:58 +08:00
Eric LiangandGitHub 0a3ff489fa Send raylet error logs through the log monitor (#5351) 2019-08-05 23:35:09 -07:00
Kai YangandHao Chen 384cbfb211 Fix duplicated timeout logic in AbstractRayRuntime.get() (#5338) 2019-08-06 13:36:49 +08:00
Qing WangandEric Liang cc5c78b1da Fix the issue of not initializing GLOG 2019-08-05 13:26:09 -07:00
Zhijun FuandPhilipp Moritz 134c6bd128 [direct call] In memory store (#5303) 2019-08-05 13:14:45 -07:00
Stephanie WangandGitHub e218e615df Lineage cache performance optimization to avoid duplicate GCS requests #5327 2019-07-31 10:43:29 -07:00
Hao ChenandPhilipp Moritz 991e71dde6 Submit task asynchronously from raylet client (#5313) 2019-07-30 12:58:57 -07:00
Zhijun FuandHao Chen eb307f93f8 Support direct actor call (#5183) 2019-07-30 17:47:17 +08:00
micafanandHao Chen b3bcf59148 Rename ClientTableData to GcsNodeInfo (#5251) 2019-07-30 11:22:47 +08:00
Simon MoandRobert Nishihara 3ba8680963 Bump version to 0.8.0.dev3 (#5308) 2019-07-29 18:28:38 -07:00
Simon MoandRobert Nishihara 3b00144e7d Bump version to 0.7.3 (#5301) 2019-07-29 10:25:32 -07:00
Qing WangandGitHub 1465a30ea9 Fix releasing CPUs incorrectly when actor creation task blocked. (#5271) 
* Fix

* Remove useless log

* Address

* Fix typo

* sleep
 2019-07-28 15:46:17 +08:00
micafanandHao Chen 6f682db99d avoid copying ActorTableData when NodeMananger updates an actor to GCS (#5244) 2019-07-26 11:17:24 +08:00
Joey JiangandHao Chen 40395acadf [gRPC] Migrate raylet client implementation to grpc (#5120) 2019-07-25 14:48:56 +08:00
Eric LiangandGitHub 5b76238bce Fix two types of eviction hangs (#5225) 2019-07-23 21:20:17 -07:00
Stephanie WangandGitHub 15959b0f0d Leave ray.wait calls open until the task or actor exits (#5234) 
* Regression test

* Split TaskDependencyManager::SubscribeDependencies into ray.get and ray.wait dependencies
- Some initial implementation

* unit test

* Improve unit tests for TaskDependencyManager

* Implement SubscribeWaitDependencies and UnsubscribeWaitDependencies, unit tests passing

* Add ray.wait python test for drivers that exit early

* Add WorkerID to Worker

* Update test to use two nodes

* Regression test for ray.wait passes

* Extend regression test to include ray.wait from an actor

* Fix ClientID and WorkerIDs

* lint

* lint

* Remove unnecessary ray_get argument

* fix build
 2019-07-23 11:55:28 -07:00
Qing WangandGitHub a3d4f9f16d Fix the issue when passing multiple options in one string (#5241) 
* Fix

* Fix linting

* Fix linting

* Address

* Fix test
 2019-07-23 12:28:54 +08:00
Zhijun FuandHao Chen aa42328874 [direct call] add local plasma provider (#5184) 2019-07-19 11:29:12 +08:00
micafanandHao Chen b5b8c1d361 [GCS] introduce new gcs client and refactor actor table (#5058) 2019-07-19 11:28:34 +08:00
Richard LiawandGitHub 3e0ad11ae0 Add heartbeat test + Fix monitor.py (#5191) 2019-07-16 21:59:48 -07:00
Kai YangandHao Chen 806524384b [Java worker] Refactor object store and worker context on top of core worker (#5079) 2019-07-16 20:58:02 +08:00
Edward OakesandPhilipp Moritz e5be5fd46d Remove dependencies from TaskExecutionSpecification (#5166) 2019-07-15 18:15:21 -07:00