diff --git a/doc/source/serialization.rst b/doc/source/serialization.rst index a5e58a339..b36d48627 100644 --- a/doc/source/serialization.rst +++ b/doc/source/serialization.rst @@ -5,15 +5,6 @@ Serialization Since Ray processes do not share memory space, data transferred between workers and nodes will need to **serialized** and **deserialized**. Ray uses the `Plasma object store `_ to efficiently transfer objects across different processes and different nodes. Numpy arrays in the object store are shared between workers on the same node (zero-copy deserialization). -.. _plasma-store: - -Plasma Object Store -------------------- - -Plasma is an in-memory object store that is being developed as part of Apache Arrow. Ray uses Plasma to efficiently transfer objects across different processes and different nodes. All objects in Plasma object store are **immutable** and held in shared memory. This is so that they can be accessed efficiently by many workers on the same node. - -Each node has its own object store. When data is put into the object store, it does not get automatically broadcasted to other nodes. Data remains local to the writer until requested by another task or actor on another node. - Overview -------- @@ -21,8 +12,17 @@ Ray has decided to use a customized `Pickle protocol version 5