Commit Graph

188 Commits

Author SHA1 Message Date
Kai Yang e3b5deb741 [Multi-tenancy] Delete flag enable_multi_tenancy and remove old code path (#10573) 2020-12-10 19:01:40 +08:00
fangfengbin 260b07cf0c [PlacementGroup]Add PlacementGroup wait java api (#12499)
* add part code

* add part code

* add part code

* add part code

* fix review comments

* fix compile bug

* fix compile bug

* fix review comments

* fix review comments

* fix code style

* add part code

* fix review comments

* fix review comments

* fix code style

* rebase master

* fix bug

* fix lint error

* fix compile bug

* fix newline issue

Co-authored-by: 灵洵 <fengbin.ffb@antgroup.com>
2020-12-05 16:40:04 +08:00
Kai Yang 21fcee28f9 [Java] Simplify Ray.init() by invoking ray start internally (#10762) 2020-12-04 14:33:45 +08:00
SangBin Cho f6f3cc9af1 [Core]Remove checkpoint table (#12235)
* Delete an actor entry from node manager.

* Remove checkpoint table

* remote checkpoint interface

* remove checkpoint interface

* fix ExitActorTest

Co-authored-by: chaokunyang <shawn.ck.yang@gmail.com>
2020-12-01 08:58:36 -08:00
chaokunyang 9d133e874c [Java] support java actor class inheritance (#12001) 2020-11-23 14:07:10 +08:00
DK.Pino 0f9e2fec12 [Placement Group] Add get / get all / remove interface for Placement Group Java api. (#11821)
* add placement group java get/get all interface

* add remove placement group api

* fix some issue like: Placement Group -> placement group

* extract dumplicate code to placement group utils

* specify running mode for placement group ut

* update checkGlobalStateAccessorPointerValid -> validateGlobalStateAccessorPointer

* use THROW_EXCEPTION_AND_RETURN_IF_NOT_OK

* update pg log print
2020-11-17 12:32:39 +08:00
DK.Pino 50110b934c [Placement Group]Enhance create placement group java api (#11702)
* enhance create pg java api

* add state for PlacementGroup

* fix comment

* move default pg

* make default pg name private

* add bundle size and bundle resource size check when placement group create
2020-11-05 09:59:36 +08:00
Kai Yang abc6126814 [Java] Release actor instance reference when Ray.exitActor() is invoked (#11324) 2020-10-14 13:12:59 +08:00
Kai Yang 0c254878db [Java] Upgrade TestNG to 7.3.0 (#11135) 2020-09-30 14:38:52 +08:00
Kai Yang 79c6a6fa02 [Java] Enable retry in TestNG (#11065)
* Enable retry in Java test

* lint

* update
2020-09-28 22:16:06 +08:00
fangfengbin dd97f0c30d [Java]Fix testSetResource bug (#11064)
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-09-28 17:53:08 +08:00
bermaker 273015814d [Java Worker]Add a resource checker for java worker creation (#10948)
Co-authored-by: Kai Yang <kfstorm@outlook.com>
2020-09-22 22:00:28 +08:00
fangfengbin 1d06e025ae [Java]Add actor id when throw RayActorException (#10886) 2020-09-20 16:51:14 +08:00
Alex Wu 9a07c7b963 [1.0] Remove args from ray start (#10659) 2020-09-18 16:41:23 -07:00
chaokunyang 322f12600f bump java version to 1.1.0 (#10795) 2020-09-16 12:05:11 +08:00
Hao Chen 1a5cfe0b79 [Java] rename config ray.redis.address to ray.address (#10772) 2020-09-15 11:13:19 +08:00
Xianyang Liu 8166d71bde [Java] Support exchange ObjectRef between processes (#10729) 2020-09-13 11:54:45 +08:00
Hao Chen f7558ed2a5 Remove outdated Java doc and run demo code in CI (#10698) 2020-09-11 19:15:52 +08:00
Kai Yang afa0216280 Remove the '--include-java' option (#10594) 2020-09-09 17:01:17 +08:00
chaokunyang bbfbc98a41 [Core] Allow users to specify the classpath and import path (#10560)
* move job resource path to job config

* job resource path support list

* job resource path support for python

* fix job_resource_path support

* fix worker command

* fix job config

* use jar file instead of parent path

* fix job resource path

* add test to test.sh

* lint

* Update java/runtime/src/main/resources/ray.default.conf

Co-authored-by: Kai Yang <kfstorm@outlook.com>

* fix testGetFunctionFromLocalResource

* lint

* fix rebase

* add jars in resource path to classloader

* add job_resource_path to worker

* add ray stop

* rename job_resource_path to resource_path

* fix resource_path

* refine resource_path comments

* rename job resource path to code search path

* Add instruction about starting a cross-language cluster

* fix ClassLoaderTest.java

* add code-search-path to RunManager

* refine comments for code-search-path

* rename resourcePath to codeSearchPath

* Update doc

* fix

* rename resourcePath to codeSearchPath

* update doc

* filter out empty path

* fix comments

* fix comments

* fix tests

* revert pom

* lint

* fix doc

* update doc

* Apply suggestions from code review

* lint

Co-authored-by: Kai Yang <kfstorm@outlook.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
2020-09-09 00:46:32 +08:00
Kai Yang aa79542c77 [Java] Fix ClassLoaderTest (#10647) 2020-09-08 22:09:26 +08:00
Kai Yang ca8792e4ff [Java] Disable the multi-worker feature by default (#10593) 2020-09-08 13:10:46 +08:00
Kai Yang bd37ebb163 [Java] Fix checkstyle of UsingActorsDemo.java (#10615) 2020-09-07 21:22:56 +08:00
Kai Yang f03e91788a Java doc: "Using Actors" page (#10438) 2020-09-05 23:28:03 +08:00
fyrestone 77efad8616 Fix Java exception serialization (#10568) 2020-09-05 11:06:14 +08:00
chaokunyang 7ee0fdba3d [Java] Throw exception if Ray.init() is not called and users try to access ray API (#10497) 2020-09-05 10:09:19 +08:00
chaokunyang cf3875bd8c [Java] add exitActor API for java (#10496) 2020-09-04 10:11:42 +08:00
chaokunyang 5e4db6ad24 [Java] add default kill option (#10473) 2020-09-04 10:08:52 +08:00
Clark Zinzow 0c0b0d0a73 [Core] Added support for submission-time task names. (#10449)
* Added support for submission-time task names.

* Suggestions from code review: add missing consts

Co-authored-by: SangBin Cho <rkooo567@gmail.com>

* Add num_returns arg to actor method options docstring example.

* Add process name line and proctitle assertion to submission-time task name section of advanced docs.

* Add submission-time task name --> proctitle test for Python worker.

* Added Python actor options tests for num_returns and name.

* Added Java test for submission-time task names.

* Add dashboard image to task name docs section.

* Move to fstrings.

Co-authored-by: SangBin Cho <rkooo567@gmail.com>
2020-09-03 11:45:24 -07:00
chaokunyang ea95e6f7cc [Java] lint java code (#10494) 2020-09-03 10:39:14 +08:00
fyrestone b04222dbd9 [xlang] Cross language serialization for ActorHandle (#10335) 2020-09-02 10:11:53 +08:00
Lixin Wei 6bde6b493e [Streaming]Format java code using IDEA (#10440) 2020-08-31 19:45:00 +08:00
Stephanie Wang f75dfd60a3 [api] API deprecations and cleanups for 1.0 (internal_config and Checkpointable actor) (#10333)
* remove

* internal config updates, remove Checkpointable

* Lower object timeout default

* remove json

* Fix flaky test

* Fix unit test
2020-08-27 10:19:53 -07:00
fyrestone 08adbb371f Cross language exception (#10023) 2020-08-26 10:46:05 +08:00
fangfengbin 36c6c4b298 [Placement group] Check if placement group bundle index is valid (#10194)
* add part code

* rebase master

* add java testcase

* fix review comments

* fix lint error

* rebase master

* fix lint error

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-08-21 11:04:56 -07:00
Kai Yang 3bc17fa62a [Core] Multi-tenancy: Pass env variables from job config to worker processes (#10022) 2020-08-10 14:31:37 -07:00
Kai Yang 27cd323ce1 [Core] Multi-tenancy: Job isolation & implement per job config (except for env variables) (#9500) 2020-08-04 15:51:29 +08:00
chaokunyang 64d6446cf3 change version from 0.1-SNAPSHOT to 0.9.0-SNAPSHOT (#9778) 2020-08-01 22:38:22 +08:00
Kai Yang 006e034cdb fix lint for ReferenceCountingTest.java (#9837) 2020-07-31 17:00:00 +08:00
bermaker 88e8714bcb Fix ray java worker metric test indentation (#9834) 2020-07-31 14:39:41 +08:00
Kai Yang 02fd950252 [Java] Local and distributed ref counting in Java (#9371) 2020-07-31 11:49:31 +08:00
chaokunyang 6464bf55c6 [dist] Mvn deploy (#9777) 2020-07-30 11:48:31 +08:00
Hao Chen 260bc52254 Java doc: "Ray Core Walkthrough" page (#8595) 2020-07-30 11:13:38 +08:00
Kai Yang 2cafc7cebe [Java] Fix MetricTest.java due to incomplete changes from #9703 (#9770) 2020-07-29 12:18:17 +08:00
Kai Yang bdc005a4d4 [Java] Use test groups to filter tests of different run modes (#9703) 2020-07-29 11:18:45 +08:00
bermaker 6e23aff723 [Metrics]Ray java worker metric registry (#9636)
* ray worker metrics gauge init

* ray java metric mapping

* add jni source files for gauge and tagkey

* mapping all metric classes to stats object

* check non-null for tags and name

* lint

* add symbol for native metric JNI

* extern c for symbol

* add tests for all metrics

* Update Metric.java

use metricNativePointer instead.

* unify metric native stuff to one class

* fix jni file

* add comments for metric transform function in jni utils

* move metric function to native metric file

* remove unused disconnect jni

* Add a metric registry for java metircs

* Restore install-bazel.sh

* Add some comments for metric registry

* Fix thread safe problem of metrics

* Fix metric tests and remove sleep code from tests

* Fix comments of metrics

Co-authored-by: lingxuan.zlx <skyzlxuan@gmail.com>
2020-07-28 21:29:33 +08:00
fangfengbin 28d5f9696d Add placement group java api (#9611)
* add part code

* add part code

* add part code

* fix code style

* fix review comment

* fix review comment

* add part code

* add part code

* add part code

* add part code

* fix review comment

* fix review comment

* fix code style

* fix review comment

* fix lint error

* fix lint error

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-07-25 15:39:05 +08:00
fangfengbin 01d6edae9c fix named actor single process mode bug (#9652) 2020-07-23 20:28:50 +08:00
Kai Yang bfa0605282 [Java] Avoid data copy from C++ to Java for ByteBuffer type (#9033) 2020-07-22 16:25:32 +08:00
Lingxuan Zuo cd42450fc1 [Metrics] Java metric API (#9377) 2020-07-22 10:35:08 +08:00