Commit Graph
976 Commits
Author SHA1 Message Date
72335dbe46 [rpc] refactor RPC server code (#6661)
* refactor RPC client

* remove unused code

* format

* fix

* resolve comments

* format

* update

* refactor rpc server

* update

* format

* fix

* fix

* Update src/ray/rpc/worker/core_worker_server.h

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

* resolve comments

* format

* update

* update

* add a comment

* fix

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-01-07 22:03:42 +08:00
Edward OakesandGitHub 2a4d2c6e9e Basic reference counting & pinning (#6554) 2020-01-06 17:30:26 -06:00
mehrdadnandEdward Oakes c9855c9769 Remove std::move<std::shared_ptr>(...) to avoid bugs (#6720) 2020-01-06 17:17:26 -06:00
Zhijun FuandGitHub 5bb20f6ac9 remove unused params in grpc macros (#6677)
* remove unused params in grpc macros

* format

* fix

* format

* fix
2020-01-06 21:35:40 +08:00
mehrdadnandPhilipp Moritz 76c986bdc7 Windows compatibility stubs (#6706) 2020-01-05 21:21:17 -08:00
e6165cb14b Fix master as it seems to have been broken via these conflicting commits: (#6708)
c51fbfb453
2228079481

Co-authored-by: GitHub Web Flow <noreply@github.com>
2020-01-06 12:29:21 +08:00
fangfengbinandHao Chen 1000e3322d Add gcs server task info handler (#6695) 2020-01-06 11:09:32 +08:00
mehrdadnandPhilipp Moritz 2228079481 Fix missing overrides (#6703) 2020-01-05 17:00:23 -08:00
Philipp MoritzandGitHub e15bd8ff1a Run core worker tests in thread sanitizer and fix thread safety issues (#6701) 2020-01-05 16:18:21 -08:00
micafanandHao Chen cc110ff1e3 [GCS]Add task lease methods to TaskInfoAccessor (#6645) 2020-01-05 13:54:33 +08:00
Yunzhi ZhangandPhilipp Moritz 816b84808d [Dashboard] Display memory usage of nodes and core workers (#6671) 2020-01-03 20:12:42 -08:00
micafanandEric Liang fd379934b6 rm DirectActorTable (#6684) 2020-01-03 16:28:26 -08:00
fangfengbinandHao Chen b8669bc06c Add node resources methods to gcs server node info handler (#6685) 2020-01-03 20:06:49 +08:00
micafanandHao Chen 970cd78701 [GCS] refactor the GCS Client Dynamic Resource Interface (#6266) 2020-01-03 14:07:37 +08:00
Simon MoandGitHub 9fe90cdafc Fix async actor recursion limitation (#6672)
* Do not start threadpool when using async

* Turn function_executor into a generator

* Add new test for high concurrency and bump the default

* Set direct call
2020-01-02 19:45:13 -06:00
Yunzhi ZhangandPhilipp Moritz 8a0a30b5f0 [Dashboard] display actor status and infeasible tasks (#6652)
* expose actor status and protobuf message of infeasible tasks

* move infeasible tasks into actor tree

* add pytest for displaying infeasible tasks info

* fix base64 decoding

* fix race condition after #6629 merged
2020-01-02 14:27:59 -08:00
IonandEric Liang 3dddbef6d9 Release cpu blocked (#6611) 2020-01-02 13:43:25 -08:00
fangfengbinandHao Chen a13781d70e Add actor checkpoint methods to gcs server actor info handler (#6663) 2020-01-02 19:31:54 +08:00
micafanandHao Chen a7e9d63979 [GCS] Add actor checkpoint related methods to accessor (#6605) 2020-01-02 12:36:52 +08:00
fangfengbinandHao Chen 255aa0796a Add heartbeat methods to gcs server node info handler (#6647) 2020-01-02 12:36:23 +08:00
Zhijun FuandEric Liang 91a98d2295 [rpc] refactor GRPC client (#6637)
* refactor RPC client

* remove unused code

* format

* fix

* resolve comments

* format

* update

* fix

* fix python pb build failure

* lint
2019-12-31 22:28:25 -08:00
micafanandHao Chen cdc1ce4ebf [GCS]Add heartbeat methods to NodeInfoAccessor (#6604) 2019-12-31 14:17:35 +08:00
Yunzhi ZhangandPhilipp Moritz 65acb54553 [Dashboard] Logical view backend for dashboard (#6590) 2019-12-30 13:08:08 -08:00
Philipp MoritzandGitHub 735f282494 Use 0.9.0.dev0 as the version tag (#6630) 2019-12-30 10:14:07 -08:00
Eric LiangandGitHub 7c1e0e5715 Implement wait_local for wait (#6524) 2019-12-28 17:40:49 -08:00
Eric LiangandGitHub 677004ee3d Add 'ray stat' command for debugging (#6622)
* wip

* wip

* wip

* iterate

* move

* fix thread safety
2019-12-28 14:40:32 -08:00
Robert NishiharaandEric Liang 92db13023c Fix unused variable compilation error. (#6625) 2019-12-28 12:50:14 -08:00
fangfengbinandHao Chen 8a51efebfb Add gcs server object info handler (#6621) 2019-12-28 22:44:27 +08:00
Zhijun FuandEric Liang 088ce2d1e1 Fix hang on actor creation task failure (#6617) 2019-12-27 10:48:17 -08:00
micafanandHao Chen a492333f4e [GCS] refactor the GCS Client Object Interface (#5695) 2019-12-27 15:18:54 +08:00
fangfengbinandHao Chen 3814b6d5f3 Add gcs server node info handler (#6595) 2019-12-27 15:08:38 +08:00
Eric LiangandGitHub d3db9e9c1e By default, reconstruction should only be enabled for actor creation. (#6613)
* wip

* fix

* fix
2019-12-26 19:57:50 -08:00
micafanandHao Chen b98b288ffd [GCS] Change GCS Test to cc_test (#6596) 2019-12-26 14:34:35 +08:00
Zhijun FuandHao Chen d2bba596ab Fix actor reconstruction with direct call (#6570) 2019-12-26 10:59:50 +08:00
Bharat NaikandQing Wang cfb5934c62 Update id_specification.md (#6586)
Corrected number of bytes for actor ID.
2019-12-25 10:27:21 +08:00
micafanandHao Chen 687de41273 [GCS] refactor the GCS Client Node Interface (#6010) 2019-12-24 20:36:37 +08:00
Edward OakesandGitHub 6b1a57542e Add actor.__ray_kill__() to terminate actors immediately (#6523) 2019-12-23 23:12:57 -06:00
micafanandHao Chen 84d3d4b67b [GCS]refactor the GCS Client Task Interface (#6556) 2019-12-23 17:54:21 +08:00
Yunzhi ZhangandPhilipp Moritz bac6f3b61e [Dashboard] Collecting worker stats in node manager and implement webui display in the backend (#6574) 2019-12-22 17:50:23 -08:00
Chaokun YangandHao Chen 7bbfa85c66 [Streaming] Streaming data transfer java (#6474) 2019-12-22 10:56:05 +08:00
Edward OakesandGitHub 932cb3c297 check connected (#6565) 2019-12-20 22:04:25 -07:00
e50aa99be1 Reference counting for direct call submitted tasks (#6514)
Co-authored-by: Zhijun Fu <37800433+zhijunfu@users.noreply.github.com>
2019-12-20 17:06:33 -08:00
mehrdadnandPhilipp Moritz b0b6b56bb7 Platform shims for Windows (#6548)
* Platform shims for Windows

* Satisfy linter
2019-12-20 12:32:07 -08:00
fangfengbinandHao Chen 3c0164419b Add gcs server job info & actor info handler (#6469) 2019-12-20 14:28:04 +08:00
Eric LiangandGitHub e556b729c2 [direct call] Fix max_calls interaction with background tasks. (#6536) 2019-12-19 13:48:32 -08:00
Edward OakesandEric Liang 41fa2e9604 Remove object id translation (#6531) 2019-12-19 12:47:49 -08:00
mehrdadnandPhilipp Moritz 634b437543 Work around some compile errors for boost::asio::generic::stream_protocol (#6545) 2019-12-19 12:05:41 -08:00
Hao ChenandGitHub 7e2addb424 Revert "[GCS] refactor the GCS Client Task Interface (#5515)" (#6543)
This reverts commit f78583147c.
2019-12-19 17:11:36 +08:00
micafanandHao Chen f78583147c [GCS] refactor the GCS Client Task Interface (#5515) 2019-12-19 15:02:21 +08:00
mehrdadnandPhilipp Moritz 012c0ca7dc Fix some missing header files (#6527) 2019-12-18 16:54:51 -08:00