wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-13 13:26:25 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,027 Commits 36 Branches 42 Tags
fae99ecb8e8d750bddcb3674f720f068541dc15d
Commit Graph

4027 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Eric Liang fae99ecb8e [core] Make sure to unsubscribe get dependencies for direct task calls. (#7201) 
* fix

* remove assert
 2020-02-17 18:35:25 -08:00
ijrsvt 2116fd3bca Removing Pyarrow dependency (#7146) 2020-02-17 18:00:13 -08:00
mehrdadn 3bd82d0bcd Fix various issues/warnings that come up on Jenkins (#7147) 
* Avoid warning about swap being unlimited

Currently we get the following message on Jenkins:
"Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap."

Since we're not limiting swap anyway, we might as well avoid trying to.
https://docs.docker.com/config/containers/resource_constraints/#--memory-swap-details

* Fix escaping in re.search()

* Fix escaping in _noisy_layer()

* Raise a more descriptive error when dashboard data isn't found

* Don't error on dashboard files not being found when webui isn't required

* Change dashboard error to a warning instead
 2020-02-17 16:08:55 -08:00
Alex Wu 734629b4ea Ssh command format (#7176) 2020-02-17 14:15:42 -08:00
Alind Khare c6d768be14 [Serve] Added support for no http route services (#7010) 2020-02-17 11:31:30 -08:00
Eric Liang 42aea966ff [rllib] Convert torch state arrays to tensors during compute actions (#7162) 
* convert to tensor

* normalize fix
 2020-02-17 10:26:58 -08:00
fyrestone a6b8bd47b0 [xlang] Cross language serialize ActorHandle (#7134) 2020-02-17 20:44:56 +08:00
Edward Oakes b079787c59 Fix flaky test_get_with_timeout (#7175) 2020-02-16 21:10:16 -08:00
Richard Liaw 94e2fcea2e [sgd] fp16 (apex) and scheduler support + move examples page (#7061) 
* Init fp16

* fp16 and schedulers

* scheduler linking and fp16

* to fp16

* loss scaling and documentation

* more documentation

* add tests, refactor config

* moredocs

* more docs

* fix logo, add test mode, add fp16 flag

* fix tests

* fix scheduler

* fix apex

* improve safety

* fix tests

* fix tests

* remove pin memory default

* rm

* fix

* Update doc/examples/doc_code/raysgd_torch_signatures.py

* fix

* migrate changes from other PR

* ok thanks

* pass

* signatures

* lint'

* Update python/ray/experimental/sgd/pytorch/utils.py

* Apply suggestions from code review

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

* should address most comments

* comments

* fix this ci

* fix tests'

* testmode

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
 2020-02-16 19:04:08 -08:00
Sven Mika f0e62d733f Bazel exclude rllib-option fix. (#7185) 2020-02-16 11:26:03 -08:00
Eric Liang b7016504e8 [rllib] Only run one set of tests unless rllib or tune dirs are changed. (#7179) 
* full filter

* lint
 2020-02-16 08:52:49 -08:00
Siyuan (Ryans) Zhuang 6745459f96 Apply cpython patch bpo-39492 for the reference counting issue in pickle5 (#7177) 
* apply cpython patch bpo-39492 for the reference count issue
 2020-02-15 21:16:13 -08:00
Eric Liang b6233dff3c [rllib] Fix bad sample count assert 2020-02-15 17:22:23 -08:00
Sven Mika 2e60f0d4d8 [RLlib] Move all jenkins RLlib-tests into bazel (rllib/BUILD). (#7178) 
* commit

* comment
 2020-02-15 14:50:44 -08:00
Edward Oakes dc5a27dac0 Move ray.experimental.multiprocessing to ray.util.multiprocessing (#7149) 2020-02-14 16:17:05 -08:00
Richard Liaw 52d9189d5d [autoscaler] port-forward for attach + redis_port (#7145) 
* port-forward

* fixport

* force redis port in init mode

* test

* Update python/ray/tests/test_ray_init.py
 2020-02-14 15:17:00 -08:00
Simon Mo 30de1286bd Use pip install setup.py (#7158) 2020-02-14 13:53:36 -08:00
Adrian O'Grady fe6ce714a0 [rllib] - TaskPool.completed_prefetch() no longer returns stale object ids after an error (#7139) 2020-02-13 22:30:44 -08:00
Qing Wang f3703bafa3 [Java] Support concurrent actor calls API. (#7022) 
* WIP

Temp change

Attach native thread to jvm

* Fix run mode

* Address comments.
 2020-02-14 13:02:39 +08:00
Alex Wu 0d3687a10d No warning for docker memory > system memory (#7151) 2020-02-13 15:21:44 -08:00
Edward Oakes b81b93a9c0 Convert stress tests to projects (#6495) 2020-02-13 09:19:24 -08:00
Qing Wang 94a286ef1d [Java] Add session_dir as temp_dir for logs, socket files like Python (#7044) 
* Support

* Add gcs_server support

* Fix ut

* Fix

* Remove unused py code

* Fix linting

* Fix cross language ci

* Fix CI

* Add docstring

* Fix

* Fix linting

* Add a singleton for config

* Refine

* fix

* Fix

* linting

* Remove FileUnit

* Fix

* Fix

* Fix

* Update java/runtime/src/main/java/org/ray/runtime/config/RayConfig.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Fix streaming singleprocess CI

* Fix checkstyle

Co-authored-by: Hao Chen <chenh1024@gmail.com>
 2020-02-13 17:49:52 +08:00
Sven Mika 5518a738b3 [RLlib] Fix erroneous use of LinearSchedule (in DDPG's exploration annealing). (#7125) 
* Fix erroneous use of LinearSchedule (in DDPG's exploration annealing).
Erase schedules_obsoleted.py.

* Trigger re-test.

* Re-test.
 2020-02-12 23:46:49 -08:00
wanxing 9fc3e2e50f [Streaming]Add RefreshChannelInfo to support flow-control (#7071) 
* add RefreshChannelInfo

* fix name

* add override

* fix

* fix return value
 2020-02-13 09:30:56 +08:00
Edward Oakes e904711e74 Add python tests for serialized object ID reference counting (#7038) 2020-02-12 16:52:07 -08:00
Edward Oakes d91d3ea936 Split half of test_actor into test_actor_advanced (#7143) 2020-02-12 15:17:25 -08:00
Simon Mo 0e94e1dc2a [Asyncio] Increase recursion limit manually (#7142) 2020-02-12 14:15:36 -08:00
Sven Mika f41a9b9813 [RLlib] Fix KL method of MultiCategorial tf distribution (issue #7009). (#7119) 
* Fix KL method of MultiCategorial tf distribution.

* Fix KL method of MultiCategorial tf distribution.

* Merge AsyncReplayOptimizer fixes into this branch.
 2020-02-12 12:46:15 -08:00
Edward Oakes 275fd343fb Change CI to properly list python3.6 (#7126) 2020-02-12 11:15:46 -08:00
Mitchell Stern 5dda0b66bf [Dashboard] Refactor dialogs to use parent component state instead of routes (#7129) 2020-02-12 10:59:47 -08:00
aannadi d941ac6c89 Updating package-lock.json with latest npm (#7128) 2020-02-12 09:54:20 -08:00
Richard Liaw fc9352c588 [docs] Make walkthrough and starting Ray materials clear (#7099) 
* make starting ray a separate page

* concept

* Apply suggestions from code review

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

* more fics

* Apply suggestions from code review

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
 2020-02-11 23:17:30 -08:00
Eric Liang 305eaaabe9 Fix hang if actor object id is returned from a task that exits (#6885) 2020-02-11 20:28:13 -08:00
mehrdadn e09f63ad65 Fix build errors and add more targets to Windows builds (#6811) 
* Fix common.fbs rename (due to apache/arrow/commit/bef9a1c251397311a6415d3dc362ef419d154caa)

* Add missing COPTS

* Use socketpair(AF_INET) if boost::asio::local is unavailable (e.g. on Windows)

* Fix compile bug in service_based_gcs_client_test.cc (fix build breakage in #6686)

* Work around googletest/gmock inability to specify override to avoid -Werror,-Winconsistent-missing-override

* Fix missing override on IsPlasmaBuffer()

* Fix missing libraries for streaming

* Factor out install-toolchains.sh

* Put some Bazel flags into .bazelrc

* Fix jni_md.h missing inclusion

* Add ~/bin to PATH for Bazel

* Change echo $$(date) > $@ to date > $@

* Fix lots of unquoted paths

* Add system() call checks for Windows

Co-authored-by: GitHub Web Flow <noreply@github.com>
 2020-02-11 16:49:33 -08:00
Simon Mo 039d2cde88 Change log level for OMP warning (#7114) 2020-02-11 14:15:38 -08:00
Sven Mika 2a0e4d94aa [RLlib] Fix AsyncReplayOptimizer bug where it swallows all good worker tasks … (#7111) 2020-02-11 12:51:44 -08:00
mehrdadn fea54ab97f Use --force_pic to prevent Bazel from compiling the same files twice, which slows down the build considerably. (#7116) 2020-02-11 12:11:53 -08:00
aannadi d7ff55852a [tune][Dashboard] Added Tune Dashboard (#6911) 2020-02-11 11:56:49 -08:00
Simon Mo 0d5225c743 [Build] Use latest known tagged arrow image for linux build (#7115) 2020-02-11 11:17:48 -08:00
Simon Mo 0ddc389830 Fix documentation building with psutil issue (#7077) 2020-02-11 10:00:29 -08:00
Lingxuan Zuo 3d9bd64591 [Streaming] DataWriter use event driven model. (#7043) 
* streaming writer use event driven model.

* minor changes according reviewer comments

* Fix according to reviewer's comments

* fix bazel lint

* code polished

* Add more comments

* rename Stop & Start of EventQueue to Freeze and Unfreeze.
 2020-02-11 22:24:45 +08:00
Eric Liang 58c94f6381 [core] Delete() should never remote objects from in-memory store (#7117) 2020-02-10 22:40:09 -08:00
Simon Mo bec92a8946 [Hotfix] Fix flake8 lint failing (#7118) 2020-02-10 19:57:21 -08:00
Maksim Smolin 4139e02f01 [autoscaler] Add `--all-nodes` option to rsync-up (#7065) 
* Add option to sync workers to rsync-up

* Format

* Rename --sync-workers to --all-nodes
 2020-02-10 16:27:59 -08:00
mehrdadn ad1848b623 Comment iwyu.sh (#7110) 
Co-authored-by: GitHub Web Flow <noreply@github.com>
 2020-02-10 15:28:36 -08:00
Eric Liang 026f6884b5 [rllib] Add Decentralized DDPPO trainer and documentation (#7088) 2020-02-10 15:28:27 -08:00
Sven Mika 6e1c3ea824 [RLlib] Exploration API (+EpsilonGreedy sub-class). (#6974) 2020-02-10 15:22:07 -08:00
SangBin Cho 1e690673d8 Render tasks that are not schedulable on the dashboard. (#7034) 2020-02-10 14:23:06 -08:00
Alex Wu 3f99be8dad Add 'ray dashboard' command (#6959) 2020-02-10 12:55:21 -08:00
Alex Wu 72c31e3e19 Ray nodes should respect docker limits (#7039) 2020-02-10 11:08:38 -08:00