Richard Shin
a5df45a92e
Describe the object which wasn't serializable ( #404 )
2016-09-03 18:10:03 -07:00
Robert Nishihara
e06311d415
Automatically add relevant directories to Python paths of workers ( #380 )
...
* Make ray.init set python paths of workers.
* Decouple starting cluster from copying user source code
* also add current directory to path
* Add comments about deallocation.
* Add test for new code path.
2016-08-16 14:53:55 -07:00
Wapaul1
7246013008
Implement select to enable waiting for a specific number of remote objects to be ready. ( #369 )
2016-08-15 16:51:59 -07:00
Robert Nishihara
b29fc0c481
Use random string for worker c++ logfile. ( #378 )
2016-08-15 15:55:34 -07:00
Robert Nishihara
87bb7a8f67
[WIP] Large changes to make the tests pass. ( #376 )
...
* Revert "Make tests more informative (#372 )"
This reverts commit fd353250c8 .
* fix bugs, in particular deactivate worker service on driver and remove condition variables
* changes to minimize the changes in this PR
* switch from faulty mutex synchronization to using atomics
* Increase the default size of the message queues, to accommodate exporting large numbers of remote functions. This is a temporary fix, but not a long term solution.
* Reorganize the scheduler export code to queue up exports. This does not solve the underlying problem yet, but sets up a solution.
* Start a separate thread on driver to print error messages by constantly querying the scheduler. This is a temporary solution because the solution based on starting a worker service for the driver which the scheduler can push error messages to is buggy.
* Fix segfault in taskcapsule destructor.
* Move tests for catching errors into a separate test file.
* Revert "roll back grpc (#368 )"
This reverts commit c01ef95d04 .
2016-08-15 11:02:54 -07:00
Wapaul1
362ffa1f3c
Changing hard coded ports for objstore and workers to choose unused ports ( #365 )
...
* let grpc choose unused worker and object store ports
* Add objstore addresses to scheduler info to bring back test
2016-08-10 19:08:38 -07:00
Philipp Moritz
9903fc0335
Improve error message for serialization of custom objects ( #359 )
...
* Improve error message for serialization of custom objects
* gitignore numbuf build directory
2016-08-09 13:38:21 -07:00
Robert Nishihara
a1e4268d37
Catch errors in importing reusable variables and remote functions ( #354 )
...
* catch errors in importing reusable variables and remote functions
* updates
2016-08-07 13:53:33 -07:00
Philipp Moritz
8bf877ac1e
Serialize and Deserialize unicode ( #349 )
2016-08-04 21:06:31 -07:00
Robert Nishihara
ac363bf451
Let worker get worker address and object store address from scheduler ( #350 )
2016-08-04 17:47:08 -07:00
Robert Nishihara
98a508d6ca
Terminology change Object Reference -> Object ID ( #330 )
2016-07-31 19:58:03 -07:00
Robert Nishihara
6fd508de96
fix worker segfault
2016-07-30 14:48:18 -07:00
Robert Nishihara
8e9f98c5ff
Properly import remote functions and reusable variables on workers that register late ( #290 )
2016-07-25 16:17:17 -07:00
Philipp Moritz
5591aa4665
cleanup serialization code ( #291 )
2016-07-25 15:47:10 -07:00
Philipp Moritz
4a0f35b042
new arrow serialization code (serialize python objects recursively) ( #284 )
2016-07-25 13:41:47 -07:00
Robert Nishihara
03f1830cd0
implement key value store for sharing reusable variables
2016-07-22 18:43:33 -07:00
Robert Nishihara
baa4b7cae3
fix bug in reference counting None object ( #286 )
2016-07-22 14:15:02 -07:00
Wapaul1
b68512ec7d
Added handles for python to access buffers in objstore ( #282 )
2016-07-20 17:36:15 -07:00
mehrdadn
f2c43bec87
Function serialization ( #261 )
2016-07-17 22:05:07 -07:00
Robert Nishihara
ced5ce4924
raise exception if user tries to pass large object by value ( #276 )
2016-07-16 17:17:48 -07:00
mehrdadn
199b4efd50
int and long should be treated similarly ( #220 )
2016-07-06 17:31:58 -07:00
mehrdadn
5412d3c773
Call vec.data() instead of &vec[0] ( #219 )
2016-07-06 16:46:06 -07:00
Robert Nishihara
8297522580
don't destruct worker object before all of the object references go out of scope ( #212 )
2016-07-05 19:13:57 -07:00
Philipp Moritz
db1f10f1ec
use static qualifier for Python extension functions ( #208 )
2016-07-04 15:54:29 -07:00
Philipp Moritz
72e1b0fcd6
fix warnings ( #207 )
2016-07-04 15:40:56 -07:00
mehrdadn
5328890001
Kill workers ( #148 )
2016-06-29 22:40:04 -07:00
Robert Nishihara
72f22a238a
let scheduler distinguish drivers from workers ( #185 )
2016-06-29 21:43:06 -07:00
Philipp Moritz
7af0f1b221
Write computation graph to file
2016-06-27 12:20:30 -07:00
Philipp Moritz
8a0b8e8789
Unmap segments properly to avoid memory leaks
2016-06-24 16:56:26 -07:00
Philipp Moritz
5ecc2ab67d
Fix serialization of numpy scalars and implement more numpy types as well as empty arrays
2016-06-23 18:39:02 -07:00
Robert Nishihara
06d20352bf
Merge pull request #137 from amplab/memoryfix
...
Preparation to deallocate objects properly from object stores
2016-06-21 13:47:24 -07:00
Philipp Moritz
5281bd414f
preparation to deallocate objects properly
2016-06-21 13:46:38 -07:00
Robert Nishihara
41724399ae
print task statuses in shell ( #132 )
2016-06-21 13:28:08 -07:00
Robert Nishihara
d5fe49584a
track more task info ( #133 )
2016-06-21 10:59:32 -07:00
Philipp Moritz
e6a188b2e0
Fix memory leaks for Python dicts in C extension
2016-06-20 12:05:54 -07:00
Philipp Moritz
912fd5cc81
Write logs to files instead of printing them to stdout
2016-06-19 12:45:34 -07:00
mehrdadn
0e5feecd65
Get failed worker information ( #114 )
2016-06-17 15:01:48 -07:00
Mehrdad N
e8ed13e960
Unregistered function handling
2016-06-13 23:30:10 +00:00
Wapaul1
4e885d4896
Added RAY_CHECK with line num and file name for logs
2016-06-13 00:07:22 +00:00
Robert Nishihara
41539141af
catch exceptions on workers and pass them to the scheduler ( #93 )
2016-06-11 15:44:56 -07:00
Philipp Moritz
19e7f0d72d
implement serialization of object references inside of python objects
2016-06-10 16:32:48 -07:00
Robert Nishihara
4cc024ae36
renaming project, halo -> ray ( #95 )
2016-06-10 14:12:15 -07:00