Commit Graph

5874 Commits

Author SHA1 Message Date
fangfengbin 890fa6704f [GCS]Fix MGetValues Command to send is too large bug (#10877) 2020-09-19 12:22:20 +08:00
Eric Liang 6a227ae501 [autoscaler] Split autoscaler interface public private (#10898) 2020-09-18 18:16:23 -07:00
Alex Wu 9a07c7b963 [1.0] Remove args from ray start (#10659) 2020-09-18 16:41:23 -07:00
rkube cd7351f6a3 Streamlined slurm script and removed references to redis_password (#10827)
Co-authored-by: Ralph Kube <ralph.kube@uit.not>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-18 14:55:56 -07:00
Alex Wu e56f2b8586 [autoscaler] hotfix calculate_node_resources (#10874) 2020-09-18 13:39:00 -07:00
architkulkarni 102c498653 [Doc] Fix RayServeHandle doc (#10896) 2020-09-18 10:29:21 -07:00
Alex Wu f37b687452 [release test] Spillback test (#10788)
* .

* marked things as hidden

* removed remaining redis args

* removed huge pages and include_java

* adjust hidden fields

* lint

* readded include_java

* Delete temp

* lint

* .

* test_cli is flakey but ok

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* print

* lint

* lint
2020-09-18 09:31:07 -07:00
Richard Liaw 41d7221dcd fix (#10876) 2020-09-17 23:17:39 -07:00
Kai Fricke 508cfa3540 [tune] Support yield and return statements (#10857)
* Support `yield` and `return` statements in Tune trainable functions

* Support anonymous metric with ``tune.report(value)``

* Raise on invalid return/yield value

* Fix end to end reporter test
2020-09-17 20:18:35 -07:00
SongGuyang 5cbc411e38 [cpp worker] support cluster mode (#9977) 2020-09-18 11:08:18 +08:00
Eric Liang 1b295a17cb Add accelerator-type to multi node type example YAML (#10871) 2020-09-17 17:09:35 -07:00
SangBin Cho bc74a10748 [Core] Fix Flaky GCS actor manager test (#10600)
* Try.

* Fix the issue.

* Fix.
2020-09-17 16:10:57 -07:00
SangBin Cho fedbdd5dc6 [Doc] Broken doc build fix. (#10865) 2020-09-17 13:27:30 -07:00
Benjamin Black f2408b719c Fixed PettingZooEnv (#10847) 2020-09-17 11:28:42 -07:00
Ian Rodney a159ae72b3 [autoscaler] Ensure run_init happens in all cases (#10820)
* taking a stab at the horror that is NodeUpdaterThread

* added tests
2020-09-17 11:23:56 -07:00
Ian Rodney 47d7d83b6f [docker] Fix GPU support for tensorflow (#10779) 2020-09-17 10:56:58 -07:00
fyrestone 269e1f0b98 Fix push_error_to_driver_through_redis (#10848)
Co-authored-by: 刘宝 <po.lb@antfin.com>
2020-09-17 10:50:44 -07:00
Keqiu Hu 8a77cf925a [cli][ray] update ray cli message (#10823) 2020-09-17 09:26:55 -07:00
Kai Fricke ee99c919e3 [tune] lazy trials (#10802)
* Lazily fill trial queue

* Update interface

* Update end to end reporter test

* Removed `next_trials()` method

* Lint

* Print total number of samples to be generated in progress reporter. Allow infinite samples.

* Nit check
2020-09-17 08:51:46 -07:00
Eric Liang 89da3f9ba7 [docs] Add RayDP link to community integrations (#10851) 2020-09-17 01:21:12 -07:00
Sven Mika 5c7b35d694 [RLlib] Issue 10833 TorchPolicy GPU. (#10834) 2020-09-17 09:04:46 +02:00
SangBin Cho fe4c6ab778 [Core] Remove unused credis related code. (#10849)
* Done.

* Lint.
2020-09-16 23:34:54 -07:00
Alex Wu 6f479d4697 [hotfix] CPU Detection (#10821) 2020-09-16 21:02:52 -07:00
Sumanth Ratna 77c3414bc2 [docs] fix book icon in version flyout menu (#10844)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-16 19:41:14 -07:00
Richard Liaw d3feb83053 [tune] check for running session (#10840) 2020-09-16 18:55:11 -07:00
Richard Liaw 829a2307df [docs] raise z-index block (#10843)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Sumanth Ratna <sumanthratna@gmail.com>
2020-09-16 17:16:50 -07:00
Ameer Haj Ali 54c616e9f3 [autoscaler] Enforce CommandRunnerInterface abstractions (#10822)
Co-authored-by: root <root@ip-172-31-28-155.us-west-2.compute.internal>
Co-authored-by: Ameer Haj Ali <ameerhajali@Ameers-MacBook-Pro.local>
2020-09-16 16:56:03 -07:00
SangBin Cho 1fdb7ef6c3 [docs] Placement group documentation (#10555)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-16 16:07:55 -07:00
Alex Wu 9d0a9e73de Add java yaml example (#10835)
* java example

* Update python/ray/autoscaler/aws/example-java.yaml

Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-09-16 14:35:10 -07:00
SangBin Cho d7d4e1c87b [Doc] Document options method (#10830)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-16 14:23:24 -07:00
fyrestone 50784e2496 [Dashboard] Dashboard node grouping (#10528)
* Add RAY_NODE_ID environment var to agent

* Node ralated data use node id as key

* ray.init() return node id; Pass test_reporter.py

* Fix lint & CI

* Fix comments

* Minor fixes

* Fix CI

* Add const to ClientID in AgentManager::Options

* Use fstring

* Add comments

* Fix lint

* Add test_multi_nodes_info

Co-authored-by: 刘宝 <po.lb@antfin.com>
2020-09-16 10:17:29 -07:00
Tao Wang eb891e6c94 [TEST]make retry counts (#10463)
* make retry counts

* lint

* use function

* move methond inside
2020-09-16 10:12:30 -07:00
chaokunyang 322f12600f bump java version to 1.1.0 (#10795) 2020-09-16 12:05:11 +08:00
Kai Fricke c9fafe7733 [tune] added type hints (#10806)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-15 21:03:56 -07:00
Basasuya 5e030db8a5 [EVENT] add log reporter (#10419) 2020-09-16 11:54:05 +08:00
Kai Yang da1d171c39 Java doc: "Configuring Ray" page (#10801) 2020-09-16 11:43:16 +08:00
Eric Liang 0d9d34a3c1 [docs] Sort library list alphabetically and add experimental note to Dask (#10815)
* sort

* update

* update
2020-09-15 17:26:09 -07:00
Eric Liang f83c588f08 [rllib] Remove broken no eager on workers mode (#10745)
* remove no eager

* Update trainer.py
2020-09-15 17:25:20 -07:00
Yiran Wang c198869721 [Autoscaler] Change poll interval to 5 sec when checking VMs status (#10462) 2020-09-15 17:23:29 -07:00
Lee moon soo 65065cc19d [docker] Make python version configurable on docker image (#10783) 2020-09-15 16:07:29 -07:00
Richard Liaw 8d6fee14c7 [fix] Cite sources for example (#10798) 2020-09-15 14:37:40 -07:00
Eric Liang 3ec5fa1b51 [docs] Rename oss-users to ray-libraries (#10811) 2020-09-15 13:11:00 -07:00
architkulkarni 940f02913a [Docs] update docs readme and fix typo (#10807) 2020-09-15 12:51:18 -07:00
Amog Kamsetty d5a7c53908 [Ray SGD] use_local flag + Worker group abstraction (#10539)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-15 11:58:57 -07:00
Kai Fricke 0865d68466 [tune] convert fallback representation to numbers in wandb integration (#10799) 2020-09-15 11:47:11 -07:00
Max Fitton 334e11c704 [Dashboard] Fix a number of console warnings caused by incorrect usage of react keys (#10749)
* Fix a number of console warnings caused by incorrect usage of react keys

* lint

* lint

Co-authored-by: Max Fitton <max@semprehealth.com>
2020-09-15 11:21:44 -07:00
Siyuan (Ryans) Zhuang c2dff126aa [Core] Warn when failed to get the exact version of pickle5 (#10731)
* warn when failed to get the exact version of pickle5

* add missing spaces
2020-09-15 11:21:27 -07:00
desktable 4ccfd07a61 [RLlib] Add docstrings for agents/dqn (#10710) 2020-09-15 12:37:07 +02:00
chaokunyang 34bb61dabc [Java] Refine java driver log (#10794) 2020-09-15 17:03:03 +08:00
Richard Liaw 1a4023387d [docs] slurm + progress_bar example (#10782) 2020-09-15 00:16:36 -07:00