Package pyarrow along with ray. (#822)

* Rough pass at installing pyarrow along with Ray.

* Remove hardcoded path and try to find correct path automatically.

* Add print.

* Fix linting.

* Copy pyarrow files to a location that we manually add to python path in order to avoid interfering with pre-existing pyarrow installations.

* Move call to build.sh back into build_ext in setup.py.

* Ignore some linting errors.

* Fix problem in which pyarrow files to copy were listed before they were built.

* Fix tests by importing ray before pyarrow.
This commit is contained in:
Robert Nishihara
2017-08-07 21:17:28 -07:00
committed by Philipp Moritz
parent 0e6e38115f
commit 03f2325780
6 changed files with 59 additions and 46 deletions
+4 -2
View File
@@ -13,12 +13,14 @@ import threading
import time
import unittest
import pyarrow as pa
import pyarrow.plasma as plasma
# The ray import must come before the pyarrow import because ray modifies the
# python path so that the right version of pyarrow is found.
import ray
from ray.plasma.utils import (random_object_id,
create_object_with_id, create_object)
from ray import services
import pyarrow as pa
import pyarrow.plasma as plasma
USE_VALGRIND = False
PLASMA_STORE_MEMORY = 1000000000