Commit Graph

466 Commits

Author SHA1 Message Date
Robert Nishihara 5165b41fa7 Merge remote-tracking branch 'r1remote/moveout' into switch 2016-10-25 14:02:32 -07:00
Robert Nishihara 1915539c5f Rearrange files to prepare to merge into Ray. 2016-10-25 13:59:47 -07:00
Robert Nishihara 7c1b2f702f Remove git submodules and C++ files. 2016-10-25 12:51:30 -07:00
Robert Nishihara db6375701e Prevent ObjectIDs from being pickled. (#42) 2016-10-21 15:42:29 -07:00
Stephanie Wang da3a3127e0 Move get_client_id to db.h (#40) 2016-10-18 15:12:41 -07:00
Stephanie Wang e57b87928c Fixes for implementing Plasma fetch (#39)
* Add ability to pass callback context to object table lookup

* Propagate errors during socket writes up to caller.

* Use recv and MSG_WAITALL flag instead of looping read

* Error checking in write_bytes

* Method to listen on a network port

* Revert "Use recv and MSG_WAITALL flag instead of looping read"

This reverts commit 32d9333bc6a185729aadb4b41b70b3d7f150a9c2.

* Some documentation

* Clearer documentation

* Fix bug where database clients were getting assigned the same ID

* Regression test for unique client IDs
2016-10-18 12:38:30 -07:00
Robert Nishihara 0a44145906 Fix the resetting of reusable variables on the driver and cache functions to run on all workers. (#446)
* Properly reset reusable variables on the driver when remote functions are run locally on the driver.

* Cache functions to run on all workers that occur before ray.init is called.
2016-10-12 22:17:22 -07:00
Stephanie Wang 7e23b87a21 Merge pull request #38 from ray-project/fixwarnings
Fix warnings
2016-10-12 15:43:01 -07:00
Robert Nishihara 1c3aaf7189 Update documentation (#445)
* Update documentation for serialization.

* Update documentation for reusable variables.

* Update documentation for using Ray with TensorFlow. This change is to allow code blocks to be copied and pasted into a Python interpreter.

* Fix documentation for hyperparameter optimization example.
2016-10-12 15:41:00 -07:00
Philipp Moritz 182985015c Make warnings errors 2016-10-12 13:20:57 -07:00
Philipp Moritz 832888d473 fix formating 2016-10-12 01:10:05 -07:00
Philipp Moritz 50fb53fd91 fix compiler warnings on macOS 2016-10-12 00:56:04 -07:00
Philipp Moritz 6290cab750 fix compiler warning for linux 2016-10-12 00:23:40 -07:00
Robert Nishihara 7f515113fa Generate return object IDs in the task constructor. (#36) 2016-10-07 15:20:56 -07:00
Robert Nishihara 7be1a93d64 Move common C extension module into a different C file. (#35)
* Move common C extension module into a different C file so that the actual definitions can be more easily included in other C extensions.

* Rename common_extension_module -> common_module.
2016-10-06 19:16:09 -07:00
Robert Nishihara 90a6a99b03 Clean up task interface and add testing. (#34)
* Update c extensions and python tests.

* Updates.

* Documentation fix.

* Move c extensions into common_extension.c
2016-10-06 16:25:04 -07:00
mehrdadn c6ec36865d Update Windows patches for GRPC (#444) 2016-10-06 11:50:40 -07:00
Philipp Moritz 75441a180d add valgrind tests (#33)
* add valgrind

* install valgrind
2016-10-05 16:09:40 -07:00
Robert Nishihara 4204500d23 Fix formatting. (#32) 2016-10-05 09:17:08 -07:00
Philipp Moritz 4329afbd53 rename TASK_* -> TASK_STATUS_* (#31) 2016-10-04 16:59:44 -07:00
Philipp Moritz 8e044535e2 Python API for constructing tasks (#28)
* Python API for constructing tasks

* Fixes.
2016-10-04 15:56:24 -07:00
Philipp Moritz da5ec3b5e0 add documentation for tasks (#30) 2016-10-04 12:11:52 -07:00
Stephanie Wang f4037ad19f Plasma fixes (#29)
* Allow CHECK to take in a message

* Turn off debug statements by default

* format arguments to CHECK message

* UT list

* Socket methods that block until full message is read/written

* Address Robert and Philipp's comments

* Formatting
2016-10-03 17:55:57 -07:00
Philipp Moritz e21e9f68df API for task log and scheduled task (#25)
* API revision

* update

* make status a bitmap

* update api

* tests working

* new task log APIs

* update APIs

* write binary structures to redis

* update tests

* fix clang-format

* Fix formatting.
2016-09-29 21:12:06 -07:00
Robert Nishihara 084220b0e7 Allow reading/writing generic message types, not just tasks. (#24)
* Allow reading/writing generic message types, not just tasks.

* Allow messages of length 0 to be read/written, and handle closed sockets.

* Address comments.

* Simplify accept_client.

* Allow ports to be reused in bind_ipc_sock.
2016-09-27 18:51:35 -07:00
Richard Liaw 8925580fb6 nit for filter (#443) 2016-09-26 20:58:19 -07:00
Richard Liaw d22321da7a Changes to run TRPO (#442)
Filter/new updates

final keras changes

some changes
2016-09-26 20:20:45 -07:00
Robert Nishihara 631de92170 Build redis before libcommon. (#20) 2016-09-26 00:12:11 -07:00
Robert Nishihara 9a6991116f Small fix in test. (#441) 2016-09-25 23:08:27 -07:00
Philipp Moritz db8c0acc71 Refactor state database (#22)
* make db_connect return the connection

* rename db_conn -> db_handle

* more renaming

* clang-format

* free the db_handle
2016-09-25 21:52:06 -07:00
Philipp Moritz 1e08629013 fix submit_task for task queue (#21) 2016-09-25 16:51:24 -07:00
Philipp Moritz 7907992609 [WIP] Event loop refactoring (#19)
* task queue tests and extensions

* event loop refactor

* fix formating
2016-09-23 22:53:58 -07:00
Philipp Moritz e1b8711a01 Redis logging (#17)
* Redis logging

* Rearrange logging interfaces

* Fix test case

* Changes to logging interface and test case for logging

* Fixes

* Fix memory leaks

* Add interface method to destroy logger

* is_local -> is_direct

* Merge fix
2016-09-23 17:10:15 -07:00
Philipp Moritz 7a079547b0 task queue tests and extensions (#18)
* task queue tests and extensions

* clean up test
2016-09-22 23:15:45 -07:00
Stephanie Wang 313241e303 Asynchronous Redis IPC (#14)
* Asynchronous Redis IPC

* make valgrind happy

* cleanup
2016-09-20 22:40:35 -07:00
Philipp Moritz 6c6f2d0473 Implement object table API (#16) 2016-09-20 17:02:56 -07:00
Robert Nishihara de6ec47f9e Add a recursion depth for serialization to prevent infinite loops. (#440) 2016-09-19 17:17:42 -07:00
Philipp Moritz d11161bb01 make static libraries (#13) 2016-09-18 20:47:53 -07:00
Philipp Moritz 37f035dbd0 implementing reading and writing tasks (#11) 2016-09-18 18:06:42 -07:00
Philipp Moritz c238ae4aa0 do not re-download and rebuild redis if it already exists (#10) 2016-09-18 13:57:27 -07:00
Philipp Moritz b18f214d55 Make it possible to read and write data that is not null-terminated (#9)
* Make it possible to read and write data that is not null-terminated

* formating
2016-09-18 13:35:43 -07:00
Stephanie Wang ff11ee21ef Convert to streaming sockets (#7)
* Convert to streaming sockets

* Formatting
2016-09-17 15:15:18 -07:00
Robert Nishihara 91f16a3df0 Migrate repositories to ray-project. (#438)
* Migrate repositories to ray-project.

* Update numbuf to the migrated version.
2016-09-17 00:52:05 -07:00
Robert Nishihara 4fc42c3e1e Fix in documentation link. (#439) 2016-09-17 00:45:22 -07:00
Philipp Moritz 0b7d81cae6 API for creating task specifications (#5)
* API for creating task specifications

* fixes

* add more checks and improve comments
2016-09-17 00:03:10 -07:00
Robert Nishihara 52d953bde6 Document serialization in the object store. (#436) 2016-09-16 23:49:59 -07:00
Robert Nishihara 228525eec7 Add documentation for reusable variables. (#437) 2016-09-16 23:10:34 -07:00
Robert Nishihara 4863a5155c Cleanup setting and getting of tensorflow weights. (#385)
* Cleanup setting and getting of tensorflow weights.

* Add documentation for using TensorFlow.

* Group get_weights and set_weights in a function.

* Update readme.
2016-09-16 23:05:14 -07:00
Stephanie Wang 73f4b96253 Sockets (#3)
* Socket methods to be used by an event loop

* Git ignore build files

* File renames

* Some fixes

* Fixes

* Fixes

* Memory leakage fix
2016-09-15 16:28:52 -07:00
Robert Nishihara 1aa89a4ae6 Update numbuf to properly handle Python floats. (#435) 2016-09-15 15:44:11 -07:00