Commit Graph

49 Commits

Author SHA1 Message Date
Wapaul1 362ffa1f3c Changing hard coded ports for objstore and workers to choose unused ports (#365)
* let grpc choose unused worker and object store ports

* Add objstore addresses to scheduler info to bring back test
2016-08-10 19:08:38 -07:00
Robert Nishihara a1e4268d37 Catch errors in importing reusable variables and remote functions (#354)
* catch errors in importing reusable variables and remote functions

* updates
2016-08-07 13:53:33 -07:00
Philipp Moritz 8bf877ac1e Serialize and Deserialize unicode (#349) 2016-08-04 21:06:31 -07:00
Robert Nishihara ac363bf451 Let worker get worker address and object store address from scheduler (#350) 2016-08-04 17:47:08 -07:00
Robert Nishihara 98a508d6ca Terminology change Object Reference -> Object ID (#330) 2016-07-31 19:58:03 -07:00
Robert Nishihara 8e9f98c5ff Properly import remote functions and reusable variables on workers that register late (#290) 2016-07-25 16:17:17 -07:00
Robert Nishihara 03f1830cd0 implement key value store for sharing reusable variables 2016-07-22 18:43:33 -07:00
mehrdadn f2c43bec87 Function serialization (#261) 2016-07-17 22:05:07 -07:00
mehrdadn 199b4efd50 int and long should be treated similarly (#220) 2016-07-06 17:31:58 -07:00
Philipp Moritz 9ad2c033d4 Visualize computation graph 2016-07-01 12:13:23 -07:00
mehrdadn 5328890001 Kill workers (#148) 2016-06-29 22:40:04 -07:00
Robert Nishihara 72f22a238a let scheduler distinguish drivers from workers (#185) 2016-06-29 21:43:06 -07:00
Philipp Moritz 7af0f1b221 Write computation graph to file 2016-06-27 12:20:30 -07:00
Philipp Moritz 5ecc2ab67d Fix serialization of numpy scalars and implement more numpy types as well as empty arrays 2016-06-23 18:39:02 -07:00
Robert Nishihara 188569be37 push/pull -> put/get 2016-06-23 12:58:48 -07:00
Robert Nishihara d5fe49584a track more task info (#133) 2016-06-21 10:59:32 -07:00
mehrdadn 0e5feecd65 Get failed worker information (#114) 2016-06-17 15:01:48 -07:00
Robert Nishihara 102e3682d9 make sure the scheduler sends tasks to the worker only after the worker is ready (#116) 2016-06-16 16:04:52 -07:00
Mehrdad N e8ed13e960 Unregistered function handling 2016-06-13 23:30:10 +00:00
Robert Nishihara 41539141af catch exceptions on workers and pass them to the scheduler (#93) 2016-06-11 15:44:56 -07:00
Philipp Moritz 19e7f0d72d implement serialization of object references inside of python objects 2016-06-10 16:32:48 -07:00
Robert Nishihara 4cc024ae36 renaming project, halo -> ray (#95) 2016-06-10 14:12:15 -07:00
Robert Nishihara 67086f663e change filenames and directory structure to use halo (#81) 2016-06-03 18:32:57 -07:00
Philipp Moritz 9a36e4208e implement bool serialization 2016-06-03 12:25:12 -07:00
Philipp Moritz 073dd3642e implement none serialization 2016-06-03 12:11:30 -07:00
Robert Nishihara 6d97c55299 add computation graph (#75) 2016-06-02 16:35:46 -07:00
Robert Nishihara 23d202bb73 renaming Call -> Task (#70) 2016-05-26 16:33:30 -07:00
Robert Nishihara 6b846d2bc0 support multiple object stores, part one 2016-04-24 19:06:14 -07:00
Robert Nishihara 87bc8801ab changing segment names to include objstoreid (#50) 2016-04-22 12:07:02 -07:00
Robert Nishihara 1548a1a523 implement reference counting and much more (#43) 2016-04-18 13:05:36 -07:00
Robert Nishihara a28920bb24 Alias (#38)
* implement objref aliasing

* updates
2016-04-08 12:58:08 -07:00
Robert Nishihara 6a5eeec86b fix naming Pull -> Request 2016-04-06 22:06:53 -07:00
Philipp Moritz f5147d8e59 arrow integration for ndarrays 2016-04-05 00:57:14 -07:00
Philipp Moritz 4f5a637a8f document and clean up orchestra protocol buffer specification 2016-03-25 13:46:12 -07:00
Philipp Moritz 16d91af7b8 python dict serialization 2016-03-25 00:10:49 -07:00
Philipp Moritz dd88bae487 implement event based object store 2016-03-17 22:32:31 -07:00
Philipp Moritz 2f61cc7454 make it possible to serialize tuples 2016-03-15 18:30:11 -07:00
Philipp Moritz bcc59e898d implement object reference serialization and debugging for object stores, some fixes 2016-03-15 13:06:51 -07:00
Philipp Moritz c249efa7d1 Improved OrchPy lib error handling, fixed tests, added tests 2016-03-10 20:10:49 -08:00
Philipp Moritz 9440e0f08a backend: make objectstores more robust, add logging, add reporting back of workers 2016-03-10 16:55:56 -08:00
Robert Nishihara 08a7e4d450 implementing worker.py and miscellaneous changes 2016-03-10 12:40:05 -08:00
Philipp Moritz f47bad3828 switching from Cython to Python C API 2016-03-10 12:35:31 -08:00
Philipp Moritz 3ebf8b0699 clean up, mainly the scheduler 2016-03-02 15:23:11 -08:00
Philipp Moritz 743f843524 before refactoring 2016-03-01 01:02:08 -08:00
Philipp Moritz bade870a38 fix includes and first steps to get call working 2016-02-22 16:06:16 -08:00
Philipp Moritz 5da148c1ab getting the object store working 2016-02-22 13:55:06 -08:00
Philipp Moritz d9ce0fe33d add types proto 2016-02-10 12:31:39 -08:00
Philipp Moritz fdbc30f0d7 getting ready for some benchmarks 2016-02-10 12:12:19 -08:00
Philipp Moritz 5d51bd1bfa initial orchestra commit 2016-02-07 15:50:02 -08:00