d5815673a5
Changed ray.select() to ray.wait() and its functionality ( #426 )
...
* Re-implemented select, changed name to wait
* Changed tests for select to tests for wait
* Updated the hyperopt example to match wait
* Small fixes and improve example readme.
* Make tests pass.
2016-09-14 17:14:11 -07:00
ba56b08474
Reintroduce passing arguments by value to remote functions. ( #425 )
...
* Reintroduce passing arguments by value to remote functions.
* Check size of arguments passed by value.
* Fix computation graph visualization.
2016-09-10 21:11:18 -07:00
987db5e725
Give better error message when no workers have been registered. ( #419 )
2016-09-08 11:43:04 -07:00
11a8914684
Allow users to serialize custom classes. ( #393 )
...
* Allow serialization of custom classes.
* Add documentation and test cases, also fix pickle case.
* Don't allow old-style classes.
2016-09-06 13:28:24 -07:00
d5cb3ac090
Propagate error messages from functions that run on all workers. ( #410 )
2016-09-06 10:06:43 -07:00
6f2ed775a2
Allow arbitrary bytes in types.String ( #405 )
2016-09-03 18:05:09 -07:00
e06311d415
Automatically add relevant directories to Python paths of workers ( #380 )
...
* Make ray.init set python paths of workers.
* Decouple starting cluster from copying user source code
* also add current directory to path
* Add comments about deallocation.
* Add test for new code path.
2016-08-16 14:53:55 -07:00
7246013008
Implement select to enable waiting for a specific number of remote objects to be ready. ( #369 )
2016-08-15 16:51:59 -07:00
362ffa1f3c
Changing hard coded ports for objstore and workers to choose unused ports ( #365 )
...
* let grpc choose unused worker and object store ports
* Add objstore addresses to scheduler info to bring back test
2016-08-10 19:08:38 -07:00
a1e4268d37
Catch errors in importing reusable variables and remote functions ( #354 )
...
* catch errors in importing reusable variables and remote functions
* updates
2016-08-07 13:53:33 -07:00
8bf877ac1e
Serialize and Deserialize unicode ( #349 )
2016-08-04 21:06:31 -07:00
ac363bf451
Let worker get worker address and object store address from scheduler ( #350 )
2016-08-04 17:47:08 -07:00
98a508d6ca
Terminology change Object Reference -> Object ID ( #330 )
2016-07-31 19:58:03 -07:00
8e9f98c5ff
Properly import remote functions and reusable variables on workers that register late ( #290 )
2016-07-25 16:17:17 -07:00
03f1830cd0
implement key value store for sharing reusable variables
2016-07-22 18:43:33 -07:00
f2c43bec87
Function serialization ( #261 )
2016-07-17 22:05:07 -07:00
199b4efd50
int and long should be treated similarly ( #220 )
2016-07-06 17:31:58 -07:00
9ad2c033d4
Visualize computation graph
2016-07-01 12:13:23 -07:00
5328890001
Kill workers ( #148 )
2016-06-29 22:40:04 -07:00
72f22a238a
let scheduler distinguish drivers from workers ( #185 )
2016-06-29 21:43:06 -07:00
7af0f1b221
Write computation graph to file
2016-06-27 12:20:30 -07:00
5ecc2ab67d
Fix serialization of numpy scalars and implement more numpy types as well as empty arrays
2016-06-23 18:39:02 -07:00
188569be37
push/pull -> put/get
2016-06-23 12:58:48 -07:00
d5fe49584a
track more task info ( #133 )
2016-06-21 10:59:32 -07:00
0e5feecd65
Get failed worker information ( #114 )
2016-06-17 15:01:48 -07:00
102e3682d9
make sure the scheduler sends tasks to the worker only after the worker is ready ( #116 )
2016-06-16 16:04:52 -07:00
e8ed13e960
Unregistered function handling
2016-06-13 23:30:10 +00:00
41539141af
catch exceptions on workers and pass them to the scheduler ( #93 )
2016-06-11 15:44:56 -07:00
19e7f0d72d
implement serialization of object references inside of python objects
2016-06-10 16:32:48 -07:00
4cc024ae36
renaming project, halo -> ray ( #95 )
2016-06-10 14:12:15 -07:00
67086f663e
change filenames and directory structure to use halo ( #81 )
2016-06-03 18:32:57 -07:00
9a36e4208e
implement bool serialization
2016-06-03 12:25:12 -07:00
073dd3642e
implement none serialization
2016-06-03 12:11:30 -07:00
6d97c55299
add computation graph ( #75 )
2016-06-02 16:35:46 -07:00
23d202bb73
renaming Call -> Task ( #70 )
2016-05-26 16:33:30 -07:00
6b846d2bc0
support multiple object stores, part one
2016-04-24 19:06:14 -07:00
87bc8801ab
changing segment names to include objstoreid ( #50 )
2016-04-22 12:07:02 -07:00
1548a1a523
implement reference counting and much more ( #43 )
2016-04-18 13:05:36 -07:00
a28920bb24
Alias ( #38 )
...
* implement objref aliasing
* updates
2016-04-08 12:58:08 -07:00
6a5eeec86b
fix naming Pull -> Request
2016-04-06 22:06:53 -07:00
f5147d8e59
arrow integration for ndarrays
2016-04-05 00:57:14 -07:00
4f5a637a8f
document and clean up orchestra protocol buffer specification
2016-03-25 13:46:12 -07:00
16d91af7b8
python dict serialization
2016-03-25 00:10:49 -07:00
dd88bae487
implement event based object store
2016-03-17 22:32:31 -07:00
2f61cc7454
make it possible to serialize tuples
2016-03-15 18:30:11 -07:00
bcc59e898d
implement object reference serialization and debugging for object stores, some fixes
2016-03-15 13:06:51 -07:00
c249efa7d1
Improved OrchPy lib error handling, fixed tests, added tests
2016-03-10 20:10:49 -08:00
9440e0f08a
backend: make objectstores more robust, add logging, add reporting back of workers
2016-03-10 16:55:56 -08:00
08a7e4d450
implementing worker.py and miscellaneous changes
2016-03-10 12:40:05 -08:00
f47bad3828
switching from Cython to Python C API
2016-03-10 12:35:31 -08:00
Wapaul1