wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-14 11:17:54 +08:00
Code Issues Packages Projects Releases Wiki Activity
5,119 Commits 36 Branches 42 Tags
6d99aa34a56bda966b00772bf8c5cd04bf87a0ef
Commit Graph
1307 Commits
Author SHA1 Message Date
Stephanie WangandGitHub 6d99aa34a5 [core] Handle out-of-order actor table notifications (#9449) 
* Drop stale actor table notifications

* build

* Add num_restarts to disconnect handler

* Unit test and increment num_restarts on ALIVE, not RESTARTING

* Wait for pid to exit
 2020-07-14 22:55:04 -07:00
Zhuohan LiandGitHub 003518619f [Core] remove create_and_seal and create_and_seal_batch (#9457) 2020-07-14 14:37:13 -07:00
SangBin ChoandGitHub 539c51a003 [Core] Support GCS server port assignment. (#8962) 2020-07-14 11:49:56 -05:00
SangBin ChoandGitHub f6eb47fc1f [Stats] metrics agent exporter (#9361) 2020-07-14 11:49:16 -05:00
Siyuan (Ryans) ZhuangandGitHub d57ff5e2af Remove legacy C++ code (#9459) 2020-07-14 00:57:42 -07:00
kisuke95andGitHub 276fe109c5 change error code name of boost timer (#9417) 2020-07-14 11:50:58 +08:00
fangfengbinGitHub灵洵
 		3c90f960fb Fix gcs_pubsub_test bug(#9438) 
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-07-14 11:34:50 +08:00
Siyuan (Ryans) ZhuangandGitHub 4da97a7c99 [Core] Build raylet client as an independent component (#9434) 2020-07-13 16:00:32 -07:00
Hao ChenandGitHub e6225bdfa1 [GCS] Fix the bug about raylet receiving duplicate actor creation tasks (#9422) 2020-07-13 11:34:02 -07:00
Siyuan (Ryans) ZhuangandGitHub 381c242f6b [Core] Simplify Raylet Client (#9420) 2020-07-12 12:42:54 -07:00
Siyuan (Ryans) ZhuangandGitHub 1798deae94 [Core] Plasma RAII support (#9370) 2020-07-10 09:22:29 -07:00
SangBin ChoandGitHub d8a0d76d02 Fix macos compliation bug (#9391) 
* Fix.
 2020-07-10 09:18:09 -07:00
Kai YangandGitHub c89b59cf48 Remove the RAY_CHECK in Worker::Port() (#9348) 2020-07-10 18:06:25 +08:00
Kai YangandGitHub a98cd0670e [Java] Improve JNI performance when submitting and executing tasks (#9032) 2020-07-10 17:51:07 +08:00
Hao ChenandGitHub d49dadf891 Change Python's ObjectID to ObjectRef (#9353) 2020-07-10 17:49:04 +08:00
Tao WangandGitHub 6311e5a947 [HOTFIX] Fix compile direct_actor_transport_test on mac (#9403) 2020-07-10 17:19:34 +08:00
fangfengbinGitHub灵洵
 		35861f17a3 Fix gcs_table_storage testcase bug (#9393) 
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-07-10 16:16:28 +08:00
mehrdadnandGitHub dd2cc6eb48 Update hiredis and remove Windows patches (#9289) 
Co-authored-by: Mehrdad <noreply@github.com>
 2020-07-09 18:45:44 -07:00
Zhuohan LiGitHubEric Liang
 		8a76f4cbb5 [Core] put small objects in memory store (#8972) 
* remove the put in memory store

* put small objects directly in memory store

* cast data type

* fix another place that uses Put to spill to plasma store

* fix multiple tests related to memory limits

* partially fix test_metrics

* remove not functioning codes

* fix core_worker_test

* refactor put to plasma codes

* add a flag for the new feature

* add flag to more places

* do a warmup round for the plasma store

* lint

* lint again

* fix warmup store

* Update _raylet.pyx

Co-authored-by: Eric Liang <ekhliang@gmail.com>
 2020-07-09 15:39:40 -07:00
Alex WuandGitHub 34b85659d4 [Core] New scheduler fixes (#9186) 
* .

* test_args passes

* .

* test_basic.py::test_many_fractional_resources causes ray to hang

* test_basic.py::test_many_fractional_resources causes ray to hang

* .

* .

* useful

* test_many_fractional_resources fails instead of hanging now :)

* Passes test_fractional_resources

* .

* .

* Some cleanup

* git is hard

* cleanup

* Fixed scheduling tests

* .

* .
 2020-07-09 15:37:51 -07:00
AlisaGitHubLingxuan Zuo
 		f0a72ad985 [Core] Add placement group scheduler and some api in resource scheduler (#9039) 
* Add placement group scheduler and some api of resource scheduler.
Merge fix cv hang in multithread variables race (#8984).

* change the bundle id and delete unit count in bundle

change vector<bundle_spec> to vector<shared_ptr<bundle_spec>>

Add placement group scheduler and some api of resource scheduler.
Merge fix cv hang in multithread variables race (#8984).

change the bundle id and delete unit count in bundle

remove CheckIfSchedulable()

add comments and fix the bug in resource

* fix placement group schedule

* add placement group scheduler and change some api in resource scheduler

* fix by the comments

* fix conflict

* fix lint

* fix lint

* fix bug in merge

* fix lint

Co-authored-by: Lingxuan Zuo <skyzlxuan@gmail.com>
 2020-07-09 15:37:18 -07:00
Stephanie WangandGitHub 0389735d7a [core] Pass owner address from the workers to the raylet (#9299) 
* Add intended worker ID to GetObjectStatus, tests

* Remove TaskID owner_id

* lint

* Add owner address to task args

* Make TaskArg a virtual class, remove multi args

* Set owner address for task args

* merge

* Fix tests

* Add ObjectRefs to task dependency manager, pass from task spec args

* tmp

* tmp

* Fix

* Add ownership info for task arguments

* Convert WaitForDirectActorCallArgs

* lint

* build

* update

* build

* java

* Move code

* build

* Revert "Fix Google log directory again (#9063)"

This reverts commit 275da2e400.

* Fix free

* fix tests

* Fix tests

* build

* build

* fix

* Change assertion to warning to fix java
 2020-07-09 14:35:54 -07:00
mehrdadnandGitHub 4687b807c4 Combine different severities into the same log files (#9230) 
* Combine different severities into the same log files

Co-authored-by: Mehrdad <noreply@github.com>
 2020-07-09 14:14:28 -07:00
Siyuan (Ryans) ZhuangandGitHub 7e1326c0f6 [Core] Enhance common client connection (#9367) 
* enhance client connection

* add write buffer async

* read message

* add test
 2020-07-09 08:59:37 -07:00
fangfengbinandGitHub b97b474ae9 Fix GcsActorManagerTest multi-thread bug (#9358) 2020-07-09 20:03:46 +08:00
fangfengbinandGitHub 62fe403a57 Fix the bug that PollOwnerForActorOutOfScope's reply may be missing (#9330) 2020-07-09 17:33:52 +08:00
Lingxuan ZuoandGitHub 0562236533 [Stats] Make aggeration window and report interval configurable. (#9235) 2020-07-09 12:44:38 +08:00
SangBin ChoandGitHub 9f8ff2e3b1 [Core] GCS Actor Management Race Condition (#9215) 
* GCS Actor management on by default.

* Fix travis config.

* Change condition.

* Finish the initial race condition fix.

* Lint.

* Refine the codebase.

* Finish the initial version

* Improve logic.

* Remove unnecessary log messages.

* Address code review.

* Add tests

* Revert the second race condition that doesn't happen anymore, handle some edge cases. add tests.

* Address the second race condition found.

* Addressed code review.

* Addressed code review.

* Run a new unit test only when gcs actor management is on.
 2020-07-08 10:56:52 -07:00
SangBin ChoandGitHub c5aa1eb042 [GCS Actor Management] Fix a dashboard doesn't show the correct actor state. (#9275) 
* Fix a bug.

* Address code review.

* Remove an unnecessary comment.
 2020-07-08 10:55:47 -07:00
Ian RodneyandGitHub 9172f8c3a6 [core] Store Internal Config in GCS (#8921) 2020-07-08 11:22:08 -05:00
ZhuSenlinandGitHub 42f8f16c04 [GCS] Fix detached actor with empty name (#9283) 2020-07-08 12:21:24 +08:00
yncxcwandGitHub 4ba4110dec [Core] Make worker_register_timeout_seconds configurable (#9221) 2020-07-07 18:27:15 -05:00
SangBin ChoandGitHub 8f19f1eafb [Core] Actor handle refactoring (#8895) 
* Marking needed changes.

* Resolve basic dependencies.

* In progress.

* linting.

* In progress 2.

* Linting.

* Refactor done. Cleanup needed.

* Linting.

* Recover kill actor in core worker because it is used inside raylet

* Cleanup.

* Use unique pointer instead. Unit tests are broken now.

* Fix the upstream change.

* Addressed code review 1.

* Lint.

* Addressed code review 2.

* Fix weird github history.

* Lint.

* Linting using clang 7.0.

* Use a better check message.

* Revert cpp stuff.

* Fix weird linting errors.

* Manuall fix all lint issues.

* Update a newline.

* Refactor some interface.

* Addressed all code review.

* Addressed code review
 2020-07-07 11:11:41 -07:00
Ian RodneyGitHubsimon-mo
 		a1e14380ce [core] Switch Async Callback to C++ [WIP] (#9228) 
Co-authored-by: simon-mo <simon.mo@hey.com>
 2020-07-07 09:47:25 -07:00
fangfengbinandGitHub 8391f66086 Fix gcs actor manager destroy actor crash bug (#9329) 2020-07-07 21:12:30 +08:00
Stephanie WangandGitHub b42d6a1ddc [core] Refactor task arguments and attach owner address (#9152) 
* Add intended worker ID to GetObjectStatus, tests

* Remove TaskID owner_id

* lint

* Add owner address to task args

* Make TaskArg a virtual class, remove multi args

* Set owner address for task args

* merge

* Fix tests

* Fix

* build

* update

* build

* java

* Move code

* build

* Revert "Fix Google log directory again (#9063)"

This reverts commit 275da2e400.

* Fix free

* x

* build

* Fix java

* Revert "Revert "Fix Google log directory again (#9063)""

This reverts commit 4a326fcb148ca09a35bc7de11d89df10edbb56e7.

* lint
 2020-07-06 21:25:14 -07:00
ChenZhileiandGitHub 6f3d993681 GCS server use worker table to handle RegisterWorker instead of redis accessor (#9168) 2020-07-06 10:37:25 +08:00
Tao WangandGitHub f7ac495a68 [Core] Use map instead of list to represent resources in heartbeat message (#9294) 2020-07-05 10:59:25 +08:00
Lingxuan ZuoandGitHub 7a2d7964d8 Bool config string stream must be in true or 1 (#9292) 2020-07-03 20:37:19 +08:00
ZhuSenlinGitHubsenlin.zsl
 		726c4cd6d4 fix actor accessor initialize inside redis gcs client (#9284) 
Co-authored-by: senlin.zsl <senlin.zsl@antfin.com>
 2020-07-03 15:48:32 +08:00
mehrdadnGitHubSimon Mo
 		29acf272b7 Build with Visual C++ (#9190) 
Co-authored-by: Mehrdad <noreply@github.com>
Co-authored-by: Simon Mo <xmo@berkeley.edu>
 2020-07-02 09:34:24 -07:00
Lingxuan ZuoandGitHub 8a1cc7f8f9 Reset bool config by checking type first (#9247) 2020-07-02 18:32:41 +08:00
fangfengbinandGitHub 8fcfcc4100 GCS server error handling for actor creation (#8899) 2020-07-02 16:27:32 +08:00
fangfengbinandGitHub a7a7bef622 Fix Java test crash due to incorrect destruction order (#9236) 2020-07-02 15:44:08 +08:00
Tao WangandGitHub d35776e92d [Core] Do not heartbeat resources if no update (#9182) 2020-07-02 13:56:49 +08:00
Lingxuan ZuoandGitHub 1491508859 [Metrics] Stats supports metric exporters (#8941) 2020-07-01 10:54:55 -05:00
ChenZhileiandGitHub c11855728a Remove raylet monitor after use GCS service (#9179) 2020-07-01 20:01:52 +08:00
chaokunyangandGitHub ab8df7afa3 Refine GetNamedActorHandle acync rpc wait (#9078) 2020-06-29 10:52:38 +08:00
Alex WuandGitHub f8ecf6de71 Small fix (#9149) 
Fixes some basic test cases
 2020-06-28 13:43:03 -07:00
fangfengbinandGitHub 1dc018d0bb Add gcs service discovery to automatically detect GCS server restart (#8735) 2020-06-28 16:50:06 +08:00