wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-31 12:41:01 +08:00
Code Issues Packages Projects Releases Wiki Activity
376 Commits 36 Branches 42 Tags
7246013008c4a6af2ca1fb2622ec6d0c5d9005df
Commit Graph
40 Commits
Author SHA1 Message Date
Wapaul1andPhilipp Moritz 7246013008 Implement select to enable waiting for a specific number of remote objects to be ready. (#369) 2016-08-15 16:51:59 -07:00
Robert NishiharaandPhilipp Moritz 87bb7a8f67 [WIP] Large changes to make the tests pass. (#376) 
* Revert "Make tests more informative (#372)"

This reverts commit fd353250c8.

* fix bugs, in particular deactivate worker service on driver and remove condition variables

* changes to minimize the changes in this PR

* switch from faulty mutex synchronization to using atomics

* Increase the default size of the message queues, to accommodate exporting large numbers of remote functions. This is a temporary fix, but not a long term solution.

* Reorganize the scheduler export code to queue up exports. This does not solve the underlying problem yet, but sets up a solution.

* Start a separate thread on driver to print error messages by constantly querying the scheduler. This is a temporary solution because the solution based on starting a worker service for the driver which the scheduler can push error messages to is buggy.

* Fix segfault in taskcapsule destructor.

* Move tests for catching errors into a separate test file.

* Revert "roll back grpc (#368)"

This reverts commit c01ef95d04.
 2016-08-15 11:02:54 -07:00
Wapaul1andPhilipp Moritz 362ffa1f3c Changing hard coded ports for objstore and workers to choose unused ports (#365) 
* let grpc choose unused worker and object store ports

* Add objstore addresses to scheduler info to bring back test
 2016-08-10 19:08:38 -07:00
Robert NishiharaandPhilipp Moritz fbc49410ec properly shutdown worker service thread (#367) 2016-08-10 16:53:24 -07:00
Robert NishiharaandPhilipp Moritz a1e4268d37 Catch errors in importing reusable variables and remote functions (#354) 
* catch errors in importing reusable variables and remote functions

* updates
 2016-08-07 13:53:33 -07:00
Robert NishiharaandPhilipp Moritz ac363bf451 Let worker get worker address and object store address from scheduler (#350) 2016-08-04 17:47:08 -07:00
Robert NishiharaandPhilipp Moritz 98a508d6ca Terminology change Object Reference -> Object ID (#330) 2016-07-31 19:58:03 -07:00
Robert NishiharaandPhilipp Moritz 8e9f98c5ff Properly import remote functions and reusable variables on workers that register late (#290) 2016-07-25 16:17:17 -07:00
Philipp MoritzandRobert Nishihara 5591aa4665 cleanup serialization code (#291) 2016-07-25 15:47:10 -07:00
Philipp MoritzandRobert Nishihara 4a0f35b042 new arrow serialization code (serialize python objects recursively) (#284) 2016-07-25 13:41:47 -07:00
Robert Nishihara 03f1830cd0 implement key value store for sharing reusable variables 2016-07-22 18:43:33 -07:00
Wapaul1andPhilipp Moritz b68512ec7d Added handles for python to access buffers in objstore (#282) 2016-07-20 17:36:15 -07:00
mehrdadnandRobert Nishihara f2c43bec87 Function serialization (#261) 2016-07-17 22:05:07 -07:00
mehrdadnandPhilipp Moritz 5328890001 Kill workers (#148) 2016-06-29 22:40:04 -07:00
Robert NishiharaandPhilipp Moritz 72f22a238a let scheduler distinguish drivers from workers (#185) 2016-06-29 21:43:06 -07:00
mehrdadnandPhilipp Moritz 27bd859925 Remove objstore_stub_ (#176) 2016-06-27 13:16:35 -07:00
Philipp Moritz 8a0b8e8789 Unmap segments properly to avoid memory leaks 2016-06-24 16:56:26 -07:00
Philipp Moritz 5281bd414f preparation to deallocate objects properly 2016-06-21 13:46:38 -07:00
mehrdadnandPhilipp Moritz 0e5feecd65 Get failed worker information (#114) 2016-06-17 15:01:48 -07:00
Mehrdad N e8ed13e960 Unregistered function handling 2016-06-13 23:30:10 +00:00
Robert NishiharaandPhilipp Moritz 41539141af catch exceptions on workers and pass them to the scheduler (#93) 2016-06-11 15:44:56 -07:00
Robert NishiharaandPhilipp Moritz 4cc024ae36 renaming project, halo -> ray (#95) 2016-06-10 14:12:15 -07:00
Robert NishiharaandPhilipp Moritz 67086f663e change filenames and directory structure to use halo (#81) 2016-06-03 18:32:57 -07:00
Robert NishiharaandPhilipp Moritz 23d202bb73 renaming Call -> Task (#70) 2016-05-26 16:33:30 -07:00
Philipp Moritz 8d0c3be28f implement serialization using numbuf 2016-04-26 15:14:04 -07:00
Robert NishiharaandPhilipp Moritz 87bc8801ab changing segment names to include objstoreid (#50) 2016-04-22 12:07:02 -07:00
Robert NishiharaandPhilipp Moritz 1548a1a523 implement reference counting and much more (#43) 2016-04-18 13:05:36 -07:00
Robert NishiharaandPhilipp Moritz a28920bb24 Alias (#38) 
* implement objref aliasing

* updates
 2016-04-08 12:58:08 -07:00
Philipp Moritz f5147d8e59 arrow integration for ndarrays 2016-04-05 00:57:14 -07:00
Philipp Moritz c1459f3603 clean up queues 2016-03-17 22:56:55 -07:00
Philipp Moritz dd88bae487 implement event based object store 2016-03-17 22:32:31 -07:00
Robert Nishihara b773003b70 make ObjStore.GetObj wait until the object is present in the object store, other miscellaneous fixes 2016-03-15 00:13:12 -07:00
Philipp Moritz c249efa7d1 Improved OrchPy lib error handling, fixed tests, added tests 2016-03-10 20:10:49 -08:00
Robert Nishihara 08a7e4d450 implementing worker.py and miscellaneous changes 2016-03-10 12:40:05 -08:00
Philipp Moritz f47bad3828 switching from Cython to Python C API 2016-03-10 12:35:31 -08:00
Philipp Moritz 954e34c0ae function return working with one return value 2016-03-05 15:11:39 -08:00
Philipp Moritz 3ebf8b0699 clean up, mainly the scheduler 2016-03-02 15:23:11 -08:00
Philipp Moritz 743f843524 before refactoring 2016-03-01 01:02:08 -08:00
Philipp Moritz bade870a38 fix includes and first steps to get call working 2016-02-22 16:06:16 -08:00
Philipp Moritz dcb73aba90 commit worker 2016-02-22 13:58:13 -08:00