mirror of https://github.com/wassname/ray.git synced 2026-06-29 21:43:13 +08:00

Files

T

fyrestone fc6259a656 Cross language serialization for primitive types (#7711 )

* Cross language serialization for Java and Python

* Use strict types when Python serializing

* Handle recursive objects in Python; Pin msgpack >= 0.6.0, < 1.0.0

* Disable gc for optimizing msgpack loads

* Fix merge bug

* Java call Python use returnType; Fix ClassLoaderTest

* Fix RayMethodsTest

* Fix checkstyle

* Fix lint

* prepare_args raises exception if try to transfer a non-deserializable object to another language

* Fix CrossLanguageInvocationTest.java, Python msgpack treat float as double

* Minor fixes

* Fix compile error on linux

* Fix lint in java/BUILD.bazel

* Fix test_failure

* Fix lint

* Class<?> to Class<T>; Refine metadata bytes.

* Rename FST to Fst; sort java dependencies

* Change Class<?>[] to Optional<Class<?>>; sort requirements in setup.py

* Improve CrossLanguageInvocationTest

* Refactor MessagePackSerializer.java

* Refactor MessagePackSerializer.java; Refine CrossLanguageInvocationTest.java

* Remove unnecessary dependencies for Java; Add getReturnType() for RayFunction in Java

* Fix bug

* Remove custom cross language type support

* Replace Serializer.Meta with MutableBoolean

* Remove @SuppressWarnings support from checkstyle.xml; Add null test in CrossLanguageInvocationTest.java

* Refine MessagePackSerializer.pack

* Ray.get support RayObject as input

* Improve comments and error info

* Remove classLoader argument from serializer

* Separate msgpack from pickle5 in Python

* Pair<byte[], MutableBoolean> to Pair<byte[], Boolean>

* Remove public static <T> T get(RayObject<T> object), use RayObject.get() instead

* Refine test

* small fixes

Co-authored-by: 刘宝 <po.lb@antfin.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>

2020-04-08 21:10:57 +08:00

java

Cross language serialization for primitive types (#7711 )

2020-04-08 21:10:57 +08:00

python

Support multiple core workers in one process (#7623 )

2020-04-07 11:01:47 +08:00

src

Support multiple core workers in one process (#7623 )

2020-04-07 11:01:47 +08:00

BUILD.bazel

Windows changes (#7315 )

2020-02-27 15:14:10 -08:00

README.md

[Streaming] Streaming data transfer java (#6474 )

2019-12-22 10:56:05 +08:00

README.md

Ray Streaming

Build streaming java
- build ray
  - bazel build //java:gen_maven_deps
  - cd java && mvn clean install -Dmaven.test.skip=true && cd ..
- build streaming
  - bazel build //streaming/java:gen_maven_deps
  - mvn clean install -Dmaven.test.skip=true
Build ray python will build ray streaming python.

Run examples

# c++ test
cd streaming/ && bazel test ...
sh src/test/run_streaming_queue_test.sh
cd ..

# python test
pushd python/ray/streaming/
pushd examples
python simple.py --input-file toy.txt
popd
pushd tests
pytest .
popd
popd

# java test
cd streaming/java/streaming-runtime
mvn test