Melih Elibol 6e06a9e338 XRay Task Forwarding Milestone (#1785) ...

Summary:
Able to run 1000 tasks with object dependencies on a set of distributed Raylets.

Raylet Changes:

Finalized ClientConnection class.
Task forwarding.
NM-to-NM heartbeats.
NM resource accounting for tasks.
Simple scheduling policy with task forwarding.
Creating and maintaining NM 2 NM long-lived connections and reusing them for task forwarding.
LineageCache Changes:

LineageCache without cleanup of tasks committed by remote nodes.
Lineage cache writeback and cleanup implementation.
ObjectManager Changes:

Object manager event loop/ClientConnection refactor.
Multithreaded object manager (disabled in this PR).
Testing Changes:

Integration tests for task submission on multiple Raylets.
Stress tests for object manager (with GCS and object store integration).


Co-authored-by: Stephanie Wang <swang@cs.berkeley.edu>
Co-authored-by: Alexey Tumanov <atumanov@gmail.com>

2018-03-31 18:02:58 -07:00

..

doc

Rearrange plasma files to prepare for merging into Ray.

2016-10-25 14:27:45 -07:00

format

Convert local scheduler messages to flatbuffers (#340)

2017-03-15 16:27:52 -07:00

test

Update logging and check macros. (#1627)

2018-02-28 15:13:00 -08:00

thirdparty

Make the Plasma store ready for Arrow integration (#579)

2017-05-31 16:24:23 -07:00

CMakeLists.txt

Gcs Asio integration (#1633)

2018-03-04 14:51:04 -08:00

plasma_manager.cc

XRay Task Forwarding Milestone (#1785)

2018-03-31 18:02:58 -07:00

plasma_manager.h

Second Part of Internal API Refactor (#1326)

2017-12-26 16:22:04 -08:00

plasma_protocol.cc

Update logging and check macros. (#1627)

2018-02-28 15:13:00 -08:00

setup-env.sh

Changes to make tests pass on Travis. (#3)

2016-10-25 22:39:21 -07:00

setup.py

Switch Python indentation from 2 spaces to 4 spaces. (#726)

2017-07-13 21:53:57 +00:00