wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-06-27 19:00:36 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,326 Commits 36 Branches 42 Tags
89aa47012a2e77c7ddcf5b82e1dcdb2fd1d0bed1
Commit Graph

229 Commits

Author SHA1 Message Date
Simon Mo 1ab98155eb [Release] Revert Enable GCS Server by Default (#7840) 2020-04-01 10:05:07 -07:00
fangfengbin e196fcdbaf Add gcs_service_enabled function to avoid getting environment variable directly (#7742) 2020-03-26 22:02:53 +08:00
fangfengbin bf866de6fd Enable GCS Service by default (#7541) 2020-03-24 14:20:23 +08:00
Robert Nishihara ee8c9ff732 Remove six and cloudpickle from setup.py. (#7694) 2020-03-23 11:42:05 -07:00
Robert Nishihara 1a0c9228d0 Remove pytest from setup.py and other minor changes. (#7700) 2020-03-23 08:46:56 -07:00
fyrestone a1ae935839 Java call Python use structured function descriptors (#7634) 2020-03-20 17:29:45 +08:00
Hao Chen 7678418210 [Java] Fix the issue that the cached value in RayObject is serialized (#7613) 2020-03-17 22:07:41 +08:00
Kai Yang 6b888b0247 [Java] Make both RayActor and RayPyActor inheriting from BaseActor (#7462) 2020-03-17 21:45:56 +08:00
fyrestone 7697ea2be2 Java call Python actor method use actor.call (#7614) 2020-03-17 14:52:43 +08:00
Kai Yang 630e48967d [Java] Allow passing internal config from raylet to Java worker (#7532) 2020-03-15 12:03:38 +08:00
Qing Wang d6365c2586 [Java] Enable stress test. (#7596) 2020-03-13 21:02:13 +08:00
Kai Yang d6e8f47065 Add a flag to disable reconstruction for a killed actor (#7346) 2020-03-13 19:10:21 +08:00
Qing Wang 575c89cf47 [Java] Pass large object by reference (#7595) 2020-03-13 18:38:03 +08:00
Qing Wang f4656d8cc3 [Java] Enable direct call by default. (#7408) 
* WIP

* Address comments.

* Linting

* Fix

* Fix

* Fix test

* Fix

* Fix single process ci

* Fix ut

* Update java/test/src/main/java/org/ray/api/test/PlasmaFreeTest.java

* Address comments

* Fix linting

* Minor update comments.

* Fix streaming CI
 2020-03-13 12:25:30 +08:00
Kai Yang 932a749fa9 Fix the java_worker_options parameter (#7537) 
* fix Java CI

* Minor fix

* move json.loads out of build_java_worker_command

* lint

* fix cross language test
 2020-03-12 10:44:23 +08:00
Stephanie Wang fdb528514b [core] Ref counting for actor handles (#7434) 
* tmp

* Move Exit handler into CoreWorker, exit once owner's ref count goes to 0

* fix build

* Remove __ray_terminate__ and add test case for distributed ref counting

* lint

* Remove unused

* Fixes for detached actor, duplicate actor handles

* Remove unused

* Remove creation return ID

* Remove ObjectIDs from python, set references in CoreWorker

* Fix crash

* Fix memory crash

* Fix tests

* fix

* fixes

* fix tests

* fix java build

* fix build

* fix

* check status

* check status
 2020-03-10 17:45:07 -07:00
fangfengbin fa785a2ad2 ServiceBasedGcsClient support detect gcs server availability and retry (#7292) 2020-03-10 21:01:07 +08:00
Qing Wang 7a33a6ea3c [Java] Enable skipped direct call cases (#7363) 
* Comment out

* Refine

* Revert
 2020-03-06 16:22:08 +08:00
Hao Chen fe7820fec9 [Java] New Java actor API (#7414) 2020-03-04 22:39:23 +08:00
Qing Wang 2771af1036 Fix the bug of unregistered workers in worker pool (#7343) 
* Fix

* Fix

* Fix complie

* Fix lint

* Fix linting

* Fix testDeleteObject

* Fix linting

* Update src/ray/raylet/worker_pool.cc

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update src/ray/raylet/worker_pool.cc

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update src/ray/raylet/worker_pool.h

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update src/ray/raylet/worker_pool.cc

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Address comments.

* FIx linting

Co-authored-by: Hao Chen <chenh1024@gmail.com>
 2020-03-02 16:30:39 +08:00
chaokunyang 8b6784de06 [Streaming] Streaming Python API (#6755) 2020-02-25 10:33:33 +08:00
Kai Yang 007333b960 [Java] Support direct call for normal tasks (#7193) 2020-02-21 10:03:34 +08:00
chaokunyang 1ae7c03e86 fix concurrently extract file (#7225) 2020-02-20 20:38:51 +08:00
fyrestone a6b8bd47b0 [xlang] Cross language serialize ActorHandle (#7134) 2020-02-17 20:44:56 +08:00
Qing Wang f3703bafa3 [Java] Support concurrent actor calls API. (#7022) 
* WIP

Temp change

Attach native thread to jvm

* Fix run mode

* Address comments.
 2020-02-14 13:02:39 +08:00
Qing Wang 94a286ef1d [Java] Add session_dir as temp_dir for logs, socket files like Python (#7044) 
* Support

* Add gcs_server support

* Fix ut

* Fix

* Remove unused py code

* Fix linting

* Fix cross language ci

* Fix CI

* Add docstring

* Fix

* Fix linting

* Add a singleton for config

* Refine

* fix

* Fix

* linting

* Remove FileUnit

* Fix

* Fix

* Fix

* Update java/runtime/src/main/java/org/ray/runtime/config/RayConfig.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Fix streaming singleprocess CI

* Fix checkstyle

Co-authored-by: Hao Chen <chenh1024@gmail.com>
 2020-02-13 17:49:52 +08:00
mehrdadn e09f63ad65 Fix build errors and add more targets to Windows builds (#6811) 
* Fix common.fbs rename (due to apache/arrow/commit/bef9a1c251397311a6415d3dc362ef419d154caa)

* Add missing COPTS

* Use socketpair(AF_INET) if boost::asio::local is unavailable (e.g. on Windows)

* Fix compile bug in service_based_gcs_client_test.cc (fix build breakage in #6686)

* Work around googletest/gmock inability to specify override to avoid -Werror,-Winconsistent-missing-override

* Fix missing override on IsPlasmaBuffer()

* Fix missing libraries for streaming

* Factor out install-toolchains.sh

* Put some Bazel flags into .bazelrc

* Fix jni_md.h missing inclusion

* Add ~/bin to PATH for Bazel

* Change echo $$(date) > $@ to date > $@

* Fix lots of unquoted paths

* Add system() call checks for Windows

Co-authored-by: GitHub Web Flow <noreply@github.com>
 2020-02-11 16:49:33 -08:00
fangfengbin 694c0f2867 [Java] Enable GCS server when running java unit tests (#7041) 
* enable gcs service when run java testcase

* fix ci bug

* fix windows compile bug

* fix ci bug

* restart ci job

* enable java testcase

* restart ci job

* restart ci job

* add debug log

* add debug log

* restart ci job

* add debug log

* restart ci

* add debug log

* fix java testcase bug

* restart ci job

* restart ci job

* restart ci job

* restart ci job

* restart ci job

* restart ci job

* restart ci job

* restart ci job
 2020-02-10 09:39:14 +08:00
fyrestone 0648bd28ef [xlang] Cross language Python support (#6709) 2020-02-08 13:01:28 +08:00
fangfengbin ade7ebfc0c Add service based gcs client (#6686) 2020-02-05 12:06:25 +08:00
Hao Chen b53d00b659 [Java] Fix Java test issues (#7000) 2020-02-03 19:21:25 +08:00
Qing Wang cfbde39ba8 [Java] Generate head redis port randomly (#6879) 
* Random head port

* address comments.
 2020-01-23 23:37:41 +08:00
chaokunyang 289e5e8aff enable maven checkstyle (#6829) 2020-01-20 23:41:54 -08:00
Qing Wang ad90693ca8 [Java] Enhancement single process mode (#6795) 
* enhancement

* Add ut

* Update java/runtime/src/main/java/org/ray/runtime/task/LocalModeTaskSubmitter.java

Co-Authored-By: Kai Yang <kfstorm@outlook.com>

* Update java/test/src/main/java/org/ray/api/test/RunModeTest.java

Co-Authored-By: Kai Yang <kfstorm@outlook.com>

* Address comments

* Use ExecutorSerivce to replace raw thread

Co-authored-by: Kai Yang <kfstorm@outlook.com>
 2020-01-15 21:38:53 +08:00
Kai Yang cd5fc81bdd Show the exit code if RunManager failed to start a process (#6797) 2020-01-15 19:31:56 +08:00
Kai Yang ddd4c42fe5 [Java] Add killActor API in Java (#6728) 
* Add killActor API in Java

* fix javadoc

* update test case

* Address comments
 2020-01-14 17:12:00 +08:00
chaokunyang 36b2634479 [Java] Remove singleton exceptions (#6765) 2020-01-13 10:28:06 +08:00
chaokunyang 723fe86882 [Java] Fix building Java with maven (#6764) 
* lint

* gen_maven_deps for ray_java_pkg
 2020-01-11 14:26:27 +08:00
chaokunyang 4097d076d4 Package ray java jars into wheels (#6600) 2020-01-10 11:41:00 +08:00
Sven 60d4d5e1aa Remove future imports (#6724) 
* Remove all __future__ imports from RLlib.

* Remove (object) again from tf_run_builder.py::TFRunBuilder.

* Fix 2xLINT warnings.

* Fix broken appo_policy import (must be appo_tf_policy)

* Remove future imports from all other ray files (not just RLlib).

* Remove future imports from all other ray files (not just RLlib).

* Remove future import blocks that contain `unicode_literals` as well.
Revert appo_tf_policy.py to appo_policy.py (belongs to another PR).

* Add two empty lines before Schedule class.

* Put back __future__ imports into determine_tests_to_run.py. Fails otherwise on a py2/print related error.
 2020-01-09 00:15:48 -08:00
Robert Nishihara 5e43b25e8c Document fault tolerance behavior. (#6698) 2020-01-06 22:34:06 -08:00
Zhijun Fu d2bba596ab Fix actor reconstruction with direct call (#6570) 2019-12-26 10:59:50 +08:00
Chaokun Yang 7bbfa85c66 [Streaming] Streaming data transfer java (#6474) 2019-12-22 10:56:05 +08:00
Chaokun Yang eca4cc7c00 Fix plasma_store_server path (#6499) 2019-12-20 14:45:51 +08:00
Kai Yang af9f76359a Fix crash caused by unit test testWaitAndCrash (#6549) 2019-12-20 11:06:53 +08:00
Kai Yang 3bb680a719 [Java] Add getAsyncContext and setAsyncContext API (#6439) 
* Add getAsyncContext and setAsyncContext API

* address comment

* fix bug

* Add test case
 2019-12-19 18:08:58 +08:00
Kai Yang 03c37c7825 [Java] Add the default redis password for Java (#6528) 2019-12-19 10:53:53 +08:00
Kai Yang 7e6defca72 fix ClassLoaderTest.java (#6502) 2019-12-18 14:48:25 +08:00
Kai Yang b7d5c8f220 [Java] Fix multiple FunctionManagers creating multiple ClassLoader s (#6434) 2019-12-16 14:04:44 +08:00
Kai Yang c2499c802f disable actor checkpointing and reconstruction test in direct call mode (#6490) 2019-12-15 17:54:31 +08:00