wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-08-11 11:24:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
423 Commits 36 Branches 42 Tags
d22321da7abe49f553c6244053bb74967e9a725c
Commit Graph
51 Commits
Author SHA1 Message Date
Robert NishiharaandPhilipp Moritz a5c026c033 Remove unused serialize/deserialize code in raylib. (#434) 2016-09-15 13:46:38 -07:00
Wapaul1andPhilipp Moritz d5815673a5 Changed ray.select() to ray.wait() and its functionality (#426) 
* Re-implemented select, changed name to wait

* Changed tests for select to tests for wait

* Updated the hyperopt example to match wait

* Small fixes and improve example readme.

* Make tests pass.
 2016-09-14 17:14:11 -07:00
Robert NishiharaandPhilipp Moritz 8c6d3a88a9 Properly decrement Python reference count in PyObjectID_hash. (#429) 2016-09-14 17:09:11 -07:00
Wapaul1andRobert Nishihara feff561ca1 Added hash function for objectids (#427) 2016-09-13 18:41:18 -07:00
Robert NishiharaandPhilipp Moritz ba56b08474 Reintroduce passing arguments by value to remote functions. (#425) 
* Reintroduce passing arguments by value to remote functions.

* Check size of arguments passed by value.

* Fix computation graph visualization.
 2016-09-10 21:11:18 -07:00
Robert NishiharaandPhilipp Moritz 987db5e725 Give better error message when no workers have been registered. (#419) 2016-09-08 11:43:04 -07:00
Robert NishiharaandPhilipp Moritz d6e3a40744 Remove unused code. (#418) 2016-09-08 11:36:17 -07:00
Robert NishiharaandPhilipp Moritz 11a8914684 Allow users to serialize custom classes. (#393) 
* Allow serialization of custom classes.

* Add documentation and test cases, also fix pickle case.

* Don't allow old-style classes.
 2016-09-06 13:28:24 -07:00
Robert NishiharaandPhilipp Moritz d5cb3ac090 Propagate error messages from functions that run on all workers. (#410) 2016-09-06 10:06:43 -07:00
Richard ShinandRobert Nishihara a5df45a92e Describe the object which wasn't serializable (#404) 2016-09-03 18:10:03 -07:00
Robert NishiharaandPhilipp Moritz e06311d415 Automatically add relevant directories to Python paths of workers (#380) 
* Make ray.init set python paths of workers.

* Decouple starting cluster from copying user source code

* also add current directory to path

* Add comments about deallocation.

* Add test for new code path.
 2016-08-16 14:53:55 -07:00
Wapaul1andPhilipp Moritz 7246013008 Implement select to enable waiting for a specific number of remote objects to be ready. (#369) 2016-08-15 16:51:59 -07:00
Robert NishiharaandPhilipp Moritz b29fc0c481 Use random string for worker c++ logfile. (#378) 2016-08-15 15:55:34 -07:00
Robert NishiharaandPhilipp Moritz 87bb7a8f67 [WIP] Large changes to make the tests pass. (#376) 
* Revert "Make tests more informative (#372)"

This reverts commit fd353250c8.

* fix bugs, in particular deactivate worker service on driver and remove condition variables

* changes to minimize the changes in this PR

* switch from faulty mutex synchronization to using atomics

* Increase the default size of the message queues, to accommodate exporting large numbers of remote functions. This is a temporary fix, but not a long term solution.

* Reorganize the scheduler export code to queue up exports. This does not solve the underlying problem yet, but sets up a solution.

* Start a separate thread on driver to print error messages by constantly querying the scheduler. This is a temporary solution because the solution based on starting a worker service for the driver which the scheduler can push error messages to is buggy.

* Fix segfault in taskcapsule destructor.

* Move tests for catching errors into a separate test file.

* Revert "roll back grpc (#368)"

This reverts commit c01ef95d04.
 2016-08-15 11:02:54 -07:00
Wapaul1andPhilipp Moritz 362ffa1f3c Changing hard coded ports for objstore and workers to choose unused ports (#365) 
* let grpc choose unused worker and object store ports

* Add objstore addresses to scheduler info to bring back test
 2016-08-10 19:08:38 -07:00
Philipp MoritzandJohann Schleier-Smith 9903fc0335 Improve error message for serialization of custom objects (#359) 
* Improve error message for serialization of custom objects

* gitignore numbuf build directory
 2016-08-09 13:38:21 -07:00
Robert NishiharaandPhilipp Moritz a1e4268d37 Catch errors in importing reusable variables and remote functions (#354) 
* catch errors in importing reusable variables and remote functions

* updates
 2016-08-07 13:53:33 -07:00
Philipp MoritzandRobert Nishihara 8bf877ac1e Serialize and Deserialize unicode (#349) 2016-08-04 21:06:31 -07:00
Robert NishiharaandPhilipp Moritz ac363bf451 Let worker get worker address and object store address from scheduler (#350) 2016-08-04 17:47:08 -07:00
Robert NishiharaandPhilipp Moritz 98a508d6ca Terminology change Object Reference -> Object ID (#330) 2016-07-31 19:58:03 -07:00
Robert Nishihara 6fd508de96 fix worker segfault 2016-07-30 14:48:18 -07:00
Robert NishiharaandPhilipp Moritz 8e9f98c5ff Properly import remote functions and reusable variables on workers that register late (#290) 2016-07-25 16:17:17 -07:00
Philipp MoritzandRobert Nishihara 5591aa4665 cleanup serialization code (#291) 2016-07-25 15:47:10 -07:00
Philipp MoritzandRobert Nishihara 4a0f35b042 new arrow serialization code (serialize python objects recursively) (#284) 2016-07-25 13:41:47 -07:00
Robert Nishihara 03f1830cd0 implement key value store for sharing reusable variables 2016-07-22 18:43:33 -07:00
Robert NishiharaandPhilipp Moritz baa4b7cae3 fix bug in reference counting None object (#286) 2016-07-22 14:15:02 -07:00
Wapaul1andPhilipp Moritz b68512ec7d Added handles for python to access buffers in objstore (#282) 2016-07-20 17:36:15 -07:00
mehrdadnandRobert Nishihara f2c43bec87 Function serialization (#261) 2016-07-17 22:05:07 -07:00
Robert NishiharaandPhilipp Moritz ced5ce4924 raise exception if user tries to pass large object by value (#276) 2016-07-16 17:17:48 -07:00
mehrdadnandPhilipp Moritz 199b4efd50 int and long should be treated similarly (#220) 2016-07-06 17:31:58 -07:00
mehrdadnandPhilipp Moritz 5412d3c773 Call vec.data() instead of &vec[0] (#219) 2016-07-06 16:46:06 -07:00
Robert NishiharaandPhilipp Moritz 8297522580 don't destruct worker object before all of the object references go out of scope (#212) 2016-07-05 19:13:57 -07:00
Philipp MoritzandRobert Nishihara db1f10f1ec use static qualifier for Python extension functions (#208) 2016-07-04 15:54:29 -07:00
Philipp MoritzandRobert Nishihara 72e1b0fcd6 fix warnings (#207) 2016-07-04 15:40:56 -07:00
mehrdadnandPhilipp Moritz 5328890001 Kill workers (#148) 2016-06-29 22:40:04 -07:00
Robert NishiharaandPhilipp Moritz 72f22a238a let scheduler distinguish drivers from workers (#185) 2016-06-29 21:43:06 -07:00
Philipp Moritz 7af0f1b221 Write computation graph to file 2016-06-27 12:20:30 -07:00
Philipp Moritz 8a0b8e8789 Unmap segments properly to avoid memory leaks 2016-06-24 16:56:26 -07:00
Philipp Moritz 5ecc2ab67d Fix serialization of numpy scalars and implement more numpy types as well as empty arrays 2016-06-23 18:39:02 -07:00
Robert NishiharaandGitHub 06d20352bf Merge pull request #137 from amplab/memoryfix 
Preparation to deallocate objects properly from object stores
 2016-06-21 13:47:24 -07:00
Philipp Moritz 5281bd414f preparation to deallocate objects properly 2016-06-21 13:46:38 -07:00
Robert NishiharaandPhilipp Moritz 41724399ae print task statuses in shell (#132) 2016-06-21 13:28:08 -07:00
Robert NishiharaandPhilipp Moritz d5fe49584a track more task info (#133) 2016-06-21 10:59:32 -07:00
Philipp Moritz e6a188b2e0 Fix memory leaks for Python dicts in C extension 2016-06-20 12:05:54 -07:00
Philipp Moritz 912fd5cc81 Write logs to files instead of printing them to stdout 2016-06-19 12:45:34 -07:00
mehrdadnandPhilipp Moritz 0e5feecd65 Get failed worker information (#114) 2016-06-17 15:01:48 -07:00
Mehrdad N e8ed13e960 Unregistered function handling 2016-06-13 23:30:10 +00:00
Wapaul1 4e885d4896 Added RAY_CHECK with line num and file name for logs 2016-06-13 00:07:22 +00:00
Robert NishiharaandPhilipp Moritz 41539141af catch exceptions on workers and pass them to the scheduler (#93) 2016-06-11 15:44:56 -07:00
Philipp Moritz 19e7f0d72d implement serialization of object references inside of python objects 2016-06-10 16:32:48 -07:00