Commit Graph

62 Commits

Author SHA1 Message Date
Kai Yang 92f1e0902e [Java] Fix return of java doc (#13601) 2021-01-21 23:57:20 +08:00
chaokunyang 33089c44e2 Fix streaming ci failure (#12830) 2020-12-30 10:45:52 +08:00
chaokunyang d1dd3410c8 [Java] Format ray java code (#13056) 2020-12-29 10:36:16 +08:00
Sumanth Ratna 932837eb4c [streaming] Remove unused imports in streaming CI tests (#12722) 2020-12-10 16:27:06 -06:00
Kai Yang e3b5deb741 [Multi-tenancy] Delete flag enable_multi_tenancy and remove old code path (#10573) 2020-12-10 19:01:40 +08:00
Kai Yang 21fcee28f9 [Java] Simplify Ray.init() by invoking ray start internally (#10762) 2020-12-04 14:33:45 +08:00
chaokunyang 0737e78445 [Java] upgrade common-collections version (#10613) 2020-10-10 11:16:12 +08:00
Kai Yang 0c254878db [Java] Upgrade TestNG to 7.3.0 (#11135) 2020-09-30 14:38:52 +08:00
chaokunyang 322f12600f bump java version to 1.1.0 (#10795) 2020-09-16 12:05:11 +08:00
chaokunyang ccf27a9ad2 [Streaming] Fix streaming ci (#10665) 2020-09-09 16:53:43 +08:00
SangBin Cho b7040f1310 Revert "[Streaming] fix streaming ci (#9675)" (#10656)
This reverts commit 3645a05644.
2020-09-08 19:07:21 -07:00
chaokunyang 3645a05644 [Streaming] fix streaming ci (#9675) 2020-09-08 22:20:58 +08:00
Lixin Wei 2b95e71dac [Streaming] Test build fixed (#10617) 2020-09-08 14:31:54 +08:00
kisuke95 b7003839bd [Core] Use core worker options to initialize (#10467)
* fix

* fix

* .
2020-09-07 16:36:43 -07:00
Lixin Wei f31ee84bfd [Streaming] Fault Tolerance Implementation (#10595) 2020-09-05 16:40:47 +08:00
SangBin Cho cb919c5e5c Revert "[Streaming] Fault Tolerance Implementation (#10008)" (#10582)
This reverts commit 1b1466748f.
2020-09-04 13:21:18 -07:00
Lixin Wei 1b1466748f [Streaming] Fault Tolerance Implementation (#10008) 2020-09-04 20:44:34 +08:00
Lixin Wei 2597b56f48 [Streaming] Change ID caption (#10523) 2020-09-03 14:15:33 +08:00
chaokunyang f10a5a40b0 [Java] Simplify ray cmd params (#10394) 2020-09-02 19:47:52 +08:00
Lixin Wei 6bde6b493e [Streaming]Format java code using IDEA (#10440) 2020-08-31 19:45:00 +08:00
chaokunyang 64d6446cf3 change version from 0.1-SNAPSHOT to 0.9.0-SNAPSHOT (#9778) 2020-08-01 22:38:22 +08:00
Kai Yang 02fd950252 [Java] Local and distributed ref counting in Java (#9371) 2020-07-31 11:49:31 +08:00
chaokunyang 6464bf55c6 [dist] Mvn deploy (#9777) 2020-07-30 11:48:31 +08:00
Lixin Wei aea3d53545 [Streaming] Supports multiple downstream collector (#9240) 2020-07-03 11:05:07 +08:00
chaokunyang acd765cb22 [Streaming] fix source loop (#9085) 2020-06-23 11:57:06 +08:00
chaokunyang 5edddf6eac [Streaming] operator chain (#8910) 2020-06-18 15:11:07 +08:00
chaokunyang cb6f337372 [Java] Refine python function (#8943) 2020-06-16 16:22:49 +08:00
chaokunyang dfa4768fc6 [Java] Refactor java api (#8858) 2020-06-12 10:49:01 +08:00
chaokunyang 700d81fa20 [Java] Remove java api sub package from test module (#8853) 2020-06-11 14:59:45 +08:00
Tianyi Chen ec5ecb661f [Streaming] Implement streaming job-worker. (#8780) 2020-06-10 14:13:55 +08:00
chaokunyang d2ef29f0d2 [Streaming] Fix streaming word count tests (#8697) 2020-06-09 11:49:19 +08:00
chaokunyang 31a4d07bc4 [Java] Rename java ObjectRef/ActorHandle (#8799) 2020-06-09 11:40:43 +08:00
chaokunyang d04953ab3c [Streaming] Union api (#8612) 2020-06-08 14:28:11 +08:00
chaokunyang bcdbe2d3d4 Streaming rich function (#8602) 2020-05-27 18:36:07 +08:00
Max Fitton 00325eb2b2 Rename max_reconstructions to max_restarts and use -1 for infinite (#8274)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-05-14 10:30:29 -05:00
chaokunyang 91f630f709 [Streaming] Streaming Cross-Lang API (#7464) 2020-04-29 13:42:08 +08:00
WuTao 32c2055c99 Streaming state (#7348) 2020-04-28 10:36:32 +08:00
chaokunyang 5cf49d5edd Fix streaming ci (#8159) 2020-04-26 20:56:58 +08:00
Tianyi Chen 0204dff1e9 [streaming]Add master and scheduler. (#8044) 2020-04-22 14:43:56 +08:00
wanxing 9345d03ffb [Streaming] Streaming data transfer supports cross language. (#7961)
* add init parameters for java

* fix bug

* cython

* fix compile

* fix test_direct_tranfer

* comment

* ChannelCreationParameter

* fix comment

* builder

* lint and fix tests

* fix single process test

* fix checkstyle and lint

* checkstyle

* lint python

Co-authored-by: wanxing <wanxing@B-458DMD6M-1753.local>
2020-04-16 15:16:48 +08:00
JianZhangYang 7b0518b993 [streaming] Async changes for resourcemanager part (#7955) 2020-04-16 14:15:45 +08:00
Qing Wang 98bfcd53bc [Java] Rename group id and package name. (#7864)
* Initial

* Change streaming's

* Fix

* Fix

* Fix org_ray

* Fix cpp file name

* Fix streaming

* Fix

* Fix

* Fix testlistening

* Fix missing sth in python

* Fix

* Fix

* Fix SPI

* Fix

* Fix complation

* Fix

* Fix CI

* Fix checkstyle

Fix checkstyle

* Fix streaming tests

* Fix streaming CI

* Fix streaming checkstyle.

* Fix build

* Fix bazel dep

* Fix

* Fix ray checkstyle

* Fix streaming checkstyle

* Fix bazel checkstyle
2020-04-12 17:59:34 +08:00
Tianyi Chen c5bf9cc472 [streaming] Sync changes for graph part. (#7827) 2020-04-09 12:30:44 +08:00
fyrestone fc6259a656 Cross language serialization for primitive types (#7711)
* Cross language serialization for Java and Python

* Use strict types when Python serializing

* Handle recursive objects in Python; Pin msgpack >= 0.6.0, < 1.0.0

* Disable gc for optimizing msgpack loads

* Fix merge bug

* Java call Python use returnType; Fix ClassLoaderTest

* Fix RayMethodsTest

* Fix checkstyle

* Fix lint

* prepare_args raises exception if try to transfer a non-deserializable object to another language

* Fix CrossLanguageInvocationTest.java, Python msgpack treat float as double

* Minor fixes

* Fix compile error on linux

* Fix lint in java/BUILD.bazel

* Fix test_failure

* Fix lint

* Class<?> to Class<T>; Refine metadata bytes.

* Rename FST to Fst; sort java dependencies

* Change Class<?>[] to Optional<Class<?>>; sort requirements in setup.py

* Improve CrossLanguageInvocationTest

* Refactor MessagePackSerializer.java

* Refactor MessagePackSerializer.java; Refine CrossLanguageInvocationTest.java

* Remove unnecessary dependencies for Java; Add getReturnType() for RayFunction in Java

* Fix bug

* Remove custom cross language type support

* Replace Serializer.Meta with MutableBoolean

* Remove @SuppressWarnings support from checkstyle.xml; Add null test in CrossLanguageInvocationTest.java

* Refine MessagePackSerializer.pack

* Ray.get support RayObject as input

* Improve comments and error info

* Remove classLoader argument from serializer

* Separate msgpack from pickle5 in Python

* Pair<byte[], MutableBoolean> to Pair<byte[], Boolean>

* Remove public static <T> T get(RayObject<T> object), use RayObject.get() instead

* Refine test

* small fixes

Co-authored-by: 刘宝 <po.lb@antfin.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-04-08 21:10:57 +08:00
Kai Yang 48b48cc8c2 Support multiple core workers in one process (#7623) 2020-04-07 11:01:47 +08:00
Tianyi Chen f889f938e5 [streaming] Use enum to define resource type. (#7813) 2020-03-31 00:03:49 +08:00
fyrestone a1ae935839 Java call Python use structured function descriptors (#7634) 2020-03-20 17:29:45 +08:00
Kai Yang 6b888b0247 [Java] Make both RayActor and RayPyActor inheriting from BaseActor (#7462) 2020-03-17 21:45:56 +08:00
fyrestone 7697ea2be2 Java call Python actor method use actor.call (#7614) 2020-03-17 14:52:43 +08:00
Qing Wang f4656d8cc3 [Java] Enable direct call by default. (#7408)
* WIP

* Address comments.

* Linting

* Fix

* Fix

* Fix test

* Fix

* Fix single process ci

* Fix ut

* Update java/test/src/main/java/org/ray/api/test/PlasmaFreeTest.java

* Address comments

* Fix linting

* Minor update comments.

* Fix streaming CI
2020-03-13 12:25:30 +08:00