Commit Graph

304 Commits

Author SHA1 Message Date
fyrestone b04222dbd9 [xlang] Cross language serialization for ActorHandle (#10335) 2020-09-02 10:11:53 +08:00
Eric Liang e5d089384b [1.0] Ray whitepaper link and tagline update (#10455) 2020-09-01 09:48:35 -07:00
chaokunyang ba3bd6b225 Fix java ci break (#10470) 2020-09-01 19:33:23 +08:00
Lixin Wei 6bde6b493e [Streaming]Format java code using IDEA (#10440) 2020-08-31 19:45:00 +08:00
Stephanie Wang f75dfd60a3 [api] API deprecations and cleanups for 1.0 (internal_config and Checkpointable actor) (#10333)
* remove

* internal config updates, remove Checkpointable

* Lower object timeout default

* remove json

* Fix flaky test

* Fix unit test
2020-08-27 10:19:53 -07:00
fyrestone 08adbb371f Cross language exception (#10023) 2020-08-26 10:46:05 +08:00
fangfengbin b61a79efd7 [Placement Group]Fix SigSegv bug (#10262)
* fix SigSegv bug

* fix review comments

* fix ut bug

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-08-23 11:33:40 -07:00
fangfengbin 36c6c4b298 [Placement group] Check if placement group bundle index is valid (#10194)
* add part code

* rebase master

* add java testcase

* fix review comments

* fix lint error

* rebase master

* fix lint error

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-08-21 11:04:56 -07:00
fangfengbin a462ae2747 [Placement Group]Add strict spread strategy (#10174)
* support STRICT_SPREAD strategy

* fix review comments

* rebase master

* fix lint error

* fix lint error

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-08-20 10:18:58 -07:00
fangfengbin edd783bc32 [Placement Group]Add soft pack strategy (#10099) 2020-08-17 12:01:34 +08:00
chaokunyang 7ffb37f711 [Java] add maven repo (#10109) 2020-08-14 11:31:01 -07:00
Kai Yang 3bc17fa62a [Core] Multi-tenancy: Pass env variables from job config to worker processes (#10022) 2020-08-10 14:31:37 -07:00
Kai Yang 37821f0b4c Support unlimited JVM options (#9910) 2020-08-10 16:08:33 +08:00
Lingxuan Zuo 9b5b16ef11 [GCS] fix gcs table get all nodes npe (#9927) 2020-08-05 10:36:06 -07:00
Barak Michener c16e1b9524 src/ray/protobuf: Break proto rules into a proper BUILD file (#9792) 2020-08-04 11:12:45 -07:00
kisuke95 3f1e3bc354 Fix wrong java pattern of DateTimeFormatter (#9902) 2020-08-04 21:19:54 +08:00
Kai Yang 27cd323ce1 [Core] Multi-tenancy: Job isolation & implement per job config (except for env variables) (#9500) 2020-08-04 15:51:29 +08:00
chaokunyang 64d6446cf3 change version from 0.1-SNAPSHOT to 0.9.0-SNAPSHOT (#9778) 2020-08-01 22:38:22 +08:00
Kai Yang 006e034cdb fix lint for ReferenceCountingTest.java (#9837) 2020-07-31 17:00:00 +08:00
bermaker 88e8714bcb Fix ray java worker metric test indentation (#9834) 2020-07-31 14:39:41 +08:00
Kai Yang 02fd950252 [Java] Local and distributed ref counting in Java (#9371) 2020-07-31 11:49:31 +08:00
mehrdadn e2c0174ab2 Factor out some Bazel options into .bazelrc (#9804)
* Factor out --keep_going in Bazel --config=ci

* Remove Bazel --test_timeout=600 for Windows

* Use global --test_output for Bazel CI

Co-authored-by: Mehrdad <noreply@github.com>
2020-07-30 18:09:31 -07:00
bermaker ccd6b90a42 Fix ray java worker metric registry indentation (#9780) 2020-07-30 13:20:24 +08:00
chaokunyang 6464bf55c6 [dist] Mvn deploy (#9777) 2020-07-30 11:48:31 +08:00
Hao Chen 260bc52254 Java doc: "Ray Core Walkthrough" page (#8595) 2020-07-30 11:13:38 +08:00
chaokunyang 5aba53e9b2 [dist] Fix travis deploy for java dist (#9768) 2020-07-30 10:59:11 +08:00
Kai Yang 2cafc7cebe [Java] Fix MetricTest.java due to incomplete changes from #9703 (#9770) 2020-07-29 12:18:17 +08:00
Kai Yang bdc005a4d4 [Java] Use test groups to filter tests of different run modes (#9703) 2020-07-29 11:18:45 +08:00
SangBin Cho 423dc96cc4 Revert "[dist] swap mac/linux wheel build order (#9746)" and "Fix package and upload ray jar (#9742)" (#9758)
* Revert "[dist] swap mac/linux wheel build order (#9746)"

This reverts commit a9340565ff.

* Revert "Fix package and upload ray jar (#9742)"

This reverts commit c290c308fe.
2020-07-28 15:34:29 -07:00
bermaker 6e23aff723 [Metrics]Ray java worker metric registry (#9636)
* ray worker metrics gauge init

* ray java metric mapping

* add jni source files for gauge and tagkey

* mapping all metric classes to stats object

* check non-null for tags and name

* lint

* add symbol for native metric JNI

* extern c for symbol

* add tests for all metrics

* Update Metric.java

use metricNativePointer instead.

* unify metric native stuff to one class

* fix jni file

* add comments for metric transform function in jni utils

* move metric function to native metric file

* remove unused disconnect jni

* Add a metric registry for java metircs

* Restore install-bazel.sh

* Add some comments for metric registry

* Fix thread safe problem of metrics

* Fix metric tests and remove sleep code from tests

* Fix comments of metrics

Co-authored-by: lingxuan.zlx <skyzlxuan@gmail.com>
2020-07-28 21:29:33 +08:00
chaokunyang a9340565ff [dist] swap mac/linux wheel build order (#9746) 2020-07-28 16:44:19 +08:00
chaokunyang c290c308fe Fix package and upload ray jar (#9742) 2020-07-28 11:53:25 +08:00
Simon Mo 7740136b93 Revert "Package and upload ray cross-platform jar (#9540)" (#9730)
This reverts commit 881032593d.
2020-07-27 10:40:21 -07:00
chaokunyang 881032593d Package and upload ray cross-platform jar (#9540) 2020-07-27 17:20:20 +08:00
fangfengbin 28d5f9696d Add placement group java api (#9611)
* add part code

* add part code

* add part code

* fix code style

* fix review comment

* fix review comment

* add part code

* add part code

* add part code

* add part code

* fix review comment

* fix review comment

* fix code style

* fix review comment

* fix lint error

* fix lint error

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-07-25 15:39:05 +08:00
fangfengbin 01d6edae9c fix named actor single process mode bug (#9652) 2020-07-23 20:28:50 +08:00
Kai Yang bfa0605282 [Java] Avoid data copy from C++ to Java for ByteBuffer type (#9033) 2020-07-22 16:25:32 +08:00
mehrdadn b14728d999 Shellcheck quoting (#9596)
* Fix SC2006: Use $(...) notation instead of legacy backticked `...`.

* Fix SC2016: Expressions don't expand in single quotes, use double quotes for that.

* Fix SC2046: Quote this to prevent word splitting.

* Fix SC2053: Quote the right-hand side of == in [[ ]] to prevent glob matching.

* Fix SC2068: Double quote array expansions to avoid re-splitting elements.

* Fix SC2086: Double quote to prevent globbing and word splitting.

* Fix SC2102: Ranges can only match single chars (mentioned due to duplicates).

* Fix SC2140: Word is of the form "A"B"C" (B indicated). Did you mean "ABC" or "A\"B\"C"?

* Fix SC2145: Argument mixes string and array. Use * or separate argument.

* Fix SC2209: warning: Use var=$(command) to assign output (or quote to assign string).

Co-authored-by: Mehrdad <noreply@github.com>
2020-07-21 21:56:41 -05:00
Lingxuan Zuo cd42450fc1 [Metrics] Java metric API (#9377) 2020-07-22 10:35:08 +08:00
mehrdadn 4f470c3fc1 Shellcheck comments (#9595) 2020-07-21 16:47:09 -05:00
mehrdadn 2554a1a997 Bazel fixes (#9519) 2020-07-19 12:53:08 -07:00
fangfengbin 008d973f62 fix java createActor NPE bug (#9532) 2020-07-17 11:01:51 +08:00
chaokunyang 9318e76b81 [Java] Named java actor (#9037) 2020-07-16 11:31:18 +08:00
chaokunyang ccc1133a7a [Java] fix redis-server binary path (#9398) 2020-07-15 10:47:16 +08:00
Kai Yang a98cd0670e [Java] Improve JNI performance when submitting and executing tasks (#9032) 2020-07-10 17:51:07 +08:00
Zhuohan Li 8a76f4cbb5 [Core] put small objects in memory store (#8972)
* remove the put in memory store

* put small objects directly in memory store

* cast data type

* fix another place that uses Put to spill to plasma store

* fix multiple tests related to memory limits

* partially fix test_metrics

* remove not functioning codes

* fix core_worker_test

* refactor put to plasma codes

* add a flag for the new feature

* add flag to more places

* do a warmup round for the plasma store

* lint

* lint again

* fix warmup store

* Update _raylet.pyx

Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-07-09 15:39:40 -07:00
Ian Rodney 9172f8c3a6 [core] Store Internal Config in GCS (#8921) 2020-07-08 11:22:08 -05:00
Stephanie Wang b42d6a1ddc [core] Refactor task arguments and attach owner address (#9152)
* Add intended worker ID to GetObjectStatus, tests

* Remove TaskID owner_id

* lint

* Add owner address to task args

* Make TaskArg a virtual class, remove multi args

* Set owner address for task args

* merge

* Fix tests

* Fix

* build

* update

* build

* java

* Move code

* build

* Revert "Fix Google log directory again (#9063)"

This reverts commit 275da2e400.

* Fix free

* x

* build

* Fix java

* Revert "Revert "Fix Google log directory again (#9063)""

This reverts commit 4a326fcb148ca09a35bc7de11d89df10edbb56e7.

* lint
2020-07-06 21:25:14 -07:00
mehrdadn 7135cb2aec Fix .exe file extensions (#9197)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-02 15:29:34 -05:00
chaokunyang b5fafe1fce [Java] fix java test (#9079) 2020-06-22 16:56:47 +08:00