Update arrow with better dataframe serialization and get rid of custo… (#1413)

* Update arrow with better dataframe serialization and get rid of custom dataframe serializers.

* Update plasma client API.

* Fix potential bug.

* Bug fix.

* Update arrow to use deduplicated file descriptors and mutable buffers.

* Fix tests.

* Update commit.

* Update commit.

* Update commit.

* Update commit.

* Update commit

* Update commit back to arrow codebase.'
This commit is contained in:
Robert Nishihara
2018-01-24 10:03:29 -08:00
committed by Philipp Moritz
parent f1303291b4
commit 5acc98e629
5 changed files with 30 additions and 29 deletions
-5
View File
@@ -6,10 +6,5 @@ from .dataframe import DataFrame
from .dataframe import from_pandas
from .dataframe import to_pandas
from .series import Series
import ray
import pandas as pd
__all__ = ["DataFrame", "from_pandas", "to_pandas", "Series"]
ray.register_custom_serializer(pd.DataFrame, use_pickle=True)
ray.register_custom_serializer(pd.core.indexes.base.Index, use_pickle=True)