Commit Graph

113 Commits

Author SHA1 Message Date
Robert Nishihara 98a508d6ca Terminology change Object Reference -> Object ID (#330) 2016-07-31 19:58:03 -07:00
Robert Nishihara 6fd508de96 fix worker segfault 2016-07-30 14:48:18 -07:00
mehrdadn 36fff9b555 Retry registering workers better (#300) 2016-07-29 00:23:31 -07:00
mehrdadn 44064389b9 Checked locking (#262)
* Lock order should be based on field order only

* Checked locking
2016-07-27 11:24:09 -07:00
Robert Nishihara 8e9f98c5ff Properly import remote functions and reusable variables on workers that register late (#290) 2016-07-25 16:17:17 -07:00
Philipp Moritz 5591aa4665 cleanup serialization code (#291) 2016-07-25 15:47:10 -07:00
Philipp Moritz 4a0f35b042 new arrow serialization code (serialize python objects recursively) (#284) 2016-07-25 13:41:47 -07:00
Robert Nishihara 03f1830cd0 implement key value store for sharing reusable variables 2016-07-22 18:43:33 -07:00
Robert Nishihara baa4b7cae3 fix bug in reference counting None object (#286) 2016-07-22 14:15:02 -07:00
Wapaul1 b68512ec7d Added handles for python to access buffers in objstore (#282) 2016-07-20 17:36:15 -07:00
Wapaul1 6c96a05ab4 Added error handling and cleanup for objstore overflowing (#275) 2016-07-18 17:45:00 -07:00
mehrdadn f2c43bec87 Function serialization (#261) 2016-07-17 22:05:07 -07:00
Robert Nishihara ced5ce4924 raise exception if user tries to pass large object by value (#276) 2016-07-16 17:17:48 -07:00
mehrdadn c5be9b96de Visual Studio - Project cleanup, warning suppression, and removal of zlib dependency (#272)
* windows_intermodule_singleton warning

* Fix some warnings from Visual Studio

* More Visual Studio project changes

* Replace zlib Visual Studio project with stub; it's not needed

* Un-enable link-time code generation
2016-07-16 13:02:51 -07:00
Robert Nishihara db8ade44f7 only let creator of message queue deallocate message queue 2016-07-12 13:40:01 -07:00
mehrdadn a1a54baa44 Use Boost IPC (#249) 2016-07-10 15:41:26 -07:00
mehrdadn cd92a8d787 Remove boost::filesystem dependency (#245) 2016-07-10 09:48:56 -07:00
mehrdadn 199b4efd50 int and long should be treated similarly (#220) 2016-07-06 17:31:58 -07:00
mehrdadn 5412d3c773 Call vec.data() instead of &vec[0] (#219) 2016-07-06 16:46:06 -07:00
Robert Nishihara 49decce6f6 print python backtrace in error message (#209) 2016-07-06 00:25:02 -07:00
Robert Nishihara 8297522580 don't destruct worker object before all of the object references go out of scope (#212) 2016-07-05 19:13:57 -07:00
Philipp Moritz db1f10f1ec use static qualifier for Python extension functions (#208) 2016-07-04 15:54:29 -07:00
Philipp Moritz 72e1b0fcd6 fix warnings (#207) 2016-07-04 15:40:56 -07:00
mehrdadn bd9901f408 Add UUID forgotten in object store IPC name; also fix Windows IPC implementation (#201) 2016-07-03 12:42:13 -07:00
mehrdadn fe5dd5d55a Boost.Interprocess hack for Windows (#202) 2016-07-02 21:08:23 -07:00
Mehrdad 9bdde6941f Simplify SynchronizedPtr 2016-07-02 17:45:38 -07:00
Robert Nishihara f5316d50fc Merge pull request #193 from amplab/visualizegraph
Visualize the computation graph
2016-07-01 13:21:01 -07:00
Philipp Moritz 9ad2c033d4 Visualize computation graph 2016-07-01 12:13:23 -07:00
mehrdadn 5821851318 C++ does not guarantee order of argument evaluation (#194) 2016-06-30 18:49:37 -07:00
mehrdadn 1de824628d Replace boost::interprocess with simple IPC (#189) 2016-06-30 16:31:48 -07:00
Robert Nishihara b155f44a12 remove some unsafe gets (#187) 2016-06-30 12:58:29 -07:00
mehrdadn 5328890001 Kill workers (#148) 2016-06-29 22:40:04 -07:00
Robert Nishihara 72f22a238a let scheduler distinguish drivers from workers (#185) 2016-06-29 21:43:06 -07:00
Robert Nishihara 8aa613b77f replace locks with synchronized 2016-06-29 15:16:36 -07:00
Robert Nishihara 17bfe77ff1 Merge pull request #141 from amplab/synchronized
Synchronized wrappers
2016-06-29 10:21:38 -07:00
Mehrdad 37cbbb1669 Synchronized 2016-06-29 10:20:55 -07:00
Philipp Moritz 891dccb0ff Set the workerid in submit_task and get_objref 2016-06-28 21:41:31 -07:00
mehrdadn 27bd859925 Remove objstore_stub_ (#176) 2016-06-27 13:16:35 -07:00
Philipp Moritz 7af0f1b221 Write computation graph to file 2016-06-27 12:20:30 -07:00
Philipp Moritz 8a0b8e8789 Unmap segments properly to avoid memory leaks 2016-06-24 16:56:26 -07:00
Robert Nishihara fde802fb45 Merge pull request #152 from amplab/fixnumpyscalar
Fix serialization of numpy scalars, implement more numpy types, empty arrays
2016-06-23 18:42:08 -07:00
Philipp Moritz 5ecc2ab67d Fix serialization of numpy scalars and implement more numpy types as well as empty arrays 2016-06-23 18:39:02 -07:00
Robert Nishihara 160bd6ed4f log duration of tasks (#150) 2016-06-23 15:34:28 -07:00
Robert Nishihara 188569be37 push/pull -> put/get 2016-06-23 12:58:48 -07:00
Robert Nishihara 06d20352bf Merge pull request #137 from amplab/memoryfix
Preparation to deallocate objects properly from object stores
2016-06-21 13:47:24 -07:00
Philipp Moritz 5281bd414f preparation to deallocate objects properly 2016-06-21 13:46:38 -07:00
Robert Nishihara 41724399ae print task statuses in shell (#132) 2016-06-21 13:28:08 -07:00
Robert Nishihara d5fe49584a track more task info (#133) 2016-06-21 10:59:32 -07:00
Philipp Moritz e6a188b2e0 Fix memory leaks for Python dicts in C extension 2016-06-20 12:05:54 -07:00
Mehrdad ce0e4eabb3 std::experimental::filesystem 2016-06-19 20:44:28 -07:00