Commit Graph

952 Commits

Author SHA1 Message Date
Eric Liang 7c1e0e5715 Implement wait_local for wait (#6524) 2019-12-28 17:40:49 -08:00
Eric Liang 677004ee3d Add 'ray stat' command for debugging (#6622)
* wip

* wip

* wip

* iterate

* move

* fix thread safety
2019-12-28 14:40:32 -08:00
Robert Nishihara 92db13023c Fix unused variable compilation error. (#6625) 2019-12-28 12:50:14 -08:00
fangfengbin 8a51efebfb Add gcs server object info handler (#6621) 2019-12-28 22:44:27 +08:00
Zhijun Fu 088ce2d1e1 Fix hang on actor creation task failure (#6617) 2019-12-27 10:48:17 -08:00
micafan a492333f4e [GCS] refactor the GCS Client Object Interface (#5695) 2019-12-27 15:18:54 +08:00
fangfengbin 3814b6d5f3 Add gcs server node info handler (#6595) 2019-12-27 15:08:38 +08:00
Eric Liang d3db9e9c1e By default, reconstruction should only be enabled for actor creation. (#6613)
* wip

* fix

* fix
2019-12-26 19:57:50 -08:00
micafan b98b288ffd [GCS] Change GCS Test to cc_test (#6596) 2019-12-26 14:34:35 +08:00
Zhijun Fu d2bba596ab Fix actor reconstruction with direct call (#6570) 2019-12-26 10:59:50 +08:00
Bharat Naik cfb5934c62 Update id_specification.md (#6586)
Corrected number of bytes for actor ID.
2019-12-25 10:27:21 +08:00
micafan 687de41273 [GCS] refactor the GCS Client Node Interface (#6010) 2019-12-24 20:36:37 +08:00
Edward Oakes 6b1a57542e Add actor.__ray_kill__() to terminate actors immediately (#6523) 2019-12-23 23:12:57 -06:00
micafan 84d3d4b67b [GCS]refactor the GCS Client Task Interface (#6556) 2019-12-23 17:54:21 +08:00
Yunzhi Zhang bac6f3b61e [Dashboard] Collecting worker stats in node manager and implement webui display in the backend (#6574) 2019-12-22 17:50:23 -08:00
Chaokun Yang 7bbfa85c66 [Streaming] Streaming data transfer java (#6474) 2019-12-22 10:56:05 +08:00
Edward Oakes 932cb3c297 check connected (#6565) 2019-12-20 22:04:25 -07:00
Edward Oakes e50aa99be1 Reference counting for direct call submitted tasks (#6514)
Co-authored-by: Zhijun Fu <37800433+zhijunfu@users.noreply.github.com>
2019-12-20 17:06:33 -08:00
mehrdadn b0b6b56bb7 Platform shims for Windows (#6548)
* Platform shims for Windows

* Satisfy linter
2019-12-20 12:32:07 -08:00
fangfengbin 3c0164419b Add gcs server job info & actor info handler (#6469) 2019-12-20 14:28:04 +08:00
Eric Liang e556b729c2 [direct call] Fix max_calls interaction with background tasks. (#6536) 2019-12-19 13:48:32 -08:00
Edward Oakes 41fa2e9604 Remove object id translation (#6531) 2019-12-19 12:47:49 -08:00
mehrdadn 634b437543 Work around some compile errors for boost::asio::generic::stream_protocol (#6545) 2019-12-19 12:05:41 -08:00
Hao Chen 7e2addb424 Revert "[GCS] refactor the GCS Client Task Interface (#5515)" (#6543)
This reverts commit f78583147c.
2019-12-19 17:11:36 +08:00
micafan f78583147c [GCS] refactor the GCS Client Task Interface (#5515) 2019-12-19 15:02:21 +08:00
mehrdadn 012c0ca7dc Fix some missing header files (#6527) 2019-12-18 16:54:51 -08:00
Yunzhi Zhang c507859a83 [Dashboard] Node resource display fix (#6521) 2019-12-18 12:07:37 -08:00
Simon Mo 26ec500ef9 Implement async get for direct actor call (#6339) 2019-12-18 11:50:21 -08:00
Kai Yang 978d72be0a Disable port sharing in grpc server (#6479) 2019-12-18 14:48:54 +08:00
Yunzhi Zhang 166560e428 [Dashboard] displays resources row (#6516) 2019-12-17 01:05:57 -08:00
Eric Liang 1a1324d2a2 Bump version from 0.8.0.dev6 -> 0.9.0.dev (#6508) 2019-12-16 23:57:42 -08:00
Edward Oakes 38b43fb3ca Optimize O(n^2) behavior in dependency resolver (#6509)
* Optimize O(n^2) behavior in dependency resolver

* fix check

* checks
2019-12-16 18:41:02 -08:00
mehrdadn 74b2e871b7 Tentative workaround for some forks and signals on Windows (#6362)
* Platform shims for Windows

* Tentative workaround for some forks and signals on Windows

* Rewrite WorkerPool::StartProcess by moving spawnvp wrapper to a separate function

* Separate spawnvp the wrappers for POSIX and Windows

* Fix rv use
2019-12-16 16:57:49 -08:00
Kai Yang c3ef8581d2 [Java] fix UT segmentation fault on exit (#6455)
* fix segmentation fault in Java test

* update comments

* address comments
2019-12-15 17:52:34 +08:00
Kai Yang 9cc0ecc6ff Fix duplicated logging if log dir is not set (#6342) 2019-12-15 13:29:36 +08:00
ZhuSenlin 6c0531683f Add gcs server as well as the unit test (#6401) 2019-12-15 13:23:42 +08:00
Edward Oakes e2b7459bfc Fix worker exit cleanup (#6450)
* working but ugly

* comments

* proper but hanging in grpc server destructor

* grpc server shutdown deadline

* fix disconnect

* lint

* shutdown_only in test

* replace shutdown
2019-12-13 16:52:50 -08:00
Eric Liang 335dade1e6 Check worker id for all core worker RPCs (#6472)
* check worker id

* fix test

* owner

* fix tests

* comments
2019-12-13 10:15:56 -08:00
Eric Liang eb6f3f86e5 Seed using multiple samples (#6471) 2019-12-12 21:41:19 -08:00
Stephanie Wang c57dcc82d1 Port actor creation to use direct calls (#6375) 2019-12-12 19:50:51 -08:00
Eric Liang 5a5c94939f [direct call] Retry failed tasks with delay (#6453)
* retry failed tasks with delay

* set to 0 for direct tests
2019-12-12 17:12:38 -08:00
Kai Yang 3adbe29450 fix core worker test hanging due to heartbeat is not working (#6416) 2019-12-12 18:16:28 +08:00
micafan 8c1520d18e [GCS] refactor the GCS Client Job Interface (#5503) 2019-12-12 16:57:32 +08:00
wanxing 64d8626d6d Optimize ray::LocalMemoryBuffer performance (#6384) 2019-12-11 21:49:52 -08:00
Eric Liang 58ac8639b9 Fix bad checks and race condition from actor_deaths and node_failures tests (#6411) 2019-12-11 14:47:24 -08:00
Edward Oakes 82f7dbc7a7 Increase TaskID size by 2 bytes, taken from JobID (#6425)
* Increase TaskID size by 2 bytes, taken from JobID

* comments

* check max job id

* fix doc

* fix local mode
2019-12-11 10:45:14 -08:00
Kai Yang a131082767 fix startup worker process count for multi-threading (#6382) 2019-12-11 20:19:49 +08:00
Edward Oakes 044527adb8 Remove ref counting dependencies on ray.get() (#6412)
* Remove ref counting dependencies on Get()

* comment

* don't send IDs when disabled

* pass through internal config

* fix

* allow reinit

* remove flag
2019-12-10 18:11:34 -08:00
mehrdadn 2f19b01898 Factor out stream protocols for Windows (#6408) 2019-12-10 15:23:30 -08:00
Chaokun Yang 6272907a57 [Streaming] Streaming data transfer and python integration (#6185) 2019-12-10 20:33:24 +08:00