Commit Graph
6383 Commits
Author SHA1 Message Date
dHannaschandGitHub 010e6cef3f Allow setting the RAY_BACKEND_LOG_LEVEL to trace. (#12012) 2020-11-17 13:10:23 -08:00
dHannaschandGitHub f0dcf01807 Clarify that Ray is not yet retrying to connect. (#12013) 2020-11-17 13:01:42 -08:00
Richard LiawandGitHub ca44222e03 [minor] log info instead of error upon ray.init rerun (#12025) 2020-11-17 12:59:24 -08:00
7f050c706b [PlacementGroup]Skip flaky testcase (#12065)
Co-authored-by: 灵洵 <fengbin.ffb@antgroup.com>
2020-11-17 12:21:34 -08:00
Simon MoandGitHub d7c95a4a90 [Serve] Rewrite Router to be Embeddable (#12019) 2020-11-17 08:28:18 -08:00
23926f3e6e [CLI] Docker Support (#11761)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-11-17 00:04:39 -08:00
chaokunyangandGitHub bea0031491 fix linux wheel build (#9896) 2020-11-17 15:49:42 +08:00
Eric LiangandGitHub 09d6ea5784 Clarify official releases vs nightly wheels 2020-11-16 23:30:40 -08:00
Amog KamsettyandGitHub f10cef93c7 [sgd] support operator.device (#12056) 2020-11-16 21:44:27 -08:00
Eric LiangandGitHub 380df89069 Lazily initialize the global state accessor in Python workers (#12054)
* wip

* fix

* fix
2020-11-16 21:35:12 -08:00
DK.PinoandGitHub 0f9e2fec12 [Placement Group] Add get / get all / remove interface for Placement Group Java api. (#11821)
* add placement group java get/get all interface

* add remove placement group api

* fix some issue like: Placement Group -> placement group

* extract dumplicate code to placement group utils

* specify running mode for placement group ut

* update checkGlobalStateAccessorPointerValid -> validateGlobalStateAccessorPointer

* use THROW_EXCEPTION_AND_RETURN_IF_NOT_OK

* update pg log print
2020-11-17 12:32:39 +08:00
Max FittonandGitHub 90574b66cc pin aiohttp to the 3.x.x version (#12051) 2020-11-16 21:54:16 -05:00
Richard LiawandGitHub 51d277f2e4 [tests] fix mock for test_cli (#12055)
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
2020-11-16 18:44:15 -08:00
Tao WangandGitHub d525e61288 [GCS]Open light heartbeat by default (#11968)
* [GCS]Open light heartbeat by default (#11689)

* Add some unit tests
2020-11-16 18:21:47 -08:00
Stephanie WangandGitHub c49554fb7a Abstract plasma store creation request queue (#12039) 2020-11-16 17:09:15 -08:00
Kai FrickeandGitHub 9f5986ee58 [tune] logger migration to ExperimentLogger classes (#11984) 2020-11-16 15:08:37 -08:00
Alan GuoandGitHub 3dc68533a9 make some private rsync, and exec_cluster arguments public (#11958)
* make some private rsync, and exec_cluster arguments public

* fix format issue

* undo make all_nodes public
2020-11-16 14:31:41 -08:00
SongGuyangandGitHub df2c2a7ce5 [cpp worker] support pass by reference on cluster mode (#11753) 2020-11-16 14:30:35 -08:00
Ameer Haj AliandGitHub 8d599bb3f5 [autoscaler] Move fill out resources to bootstrap config to cache the resources and avoid expensive boto3 calls (#12028) 2020-11-16 13:28:57 -08:00
fyrestoneandGitHub 0c6bb745cd Fix dashboard agent use incorrect ip (#12038) 2020-11-16 14:02:20 -06:00
SangBin ChoandGitHub f56d7c1a76 [Logging] Remove per worker job log file / support worker log rotation (#11927)
* In progress.

* MVP done.

* In Progress.

* Remove unnecessay code.

* Fix some issues.

* Fix test failures.

* Addressed code review + fix object spilling test failure.
2020-11-16 11:29:43 -08:00
Sven MikaandGitHub b6b54f1c81 [RLlib] Trajectory view API: enable by default for SAC, DDPG, DQN, SimpleQ (#11827) 2020-11-16 10:54:35 -08:00
8609e2dd90 [tune] refactor verbosity levels (#11767)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-11-16 10:32:53 -08:00
a50128079d [tune/placement group] dist. training placement group support (#11934)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-11-16 01:11:39 -08:00
fangfengbinandGitHub 8fb926565c [Placement Group]Placement Group supports gcs failover (Part1) (#11933) 2020-11-16 14:42:56 +08:00
dHannaschandGitHub d35de2272d [Core] Allow redis.ResponseError instead of redis.AuthenticationError (#12024)
* redis.ResponseError

* there really is no way to make this look good, is there
2020-11-15 15:04:56 -08:00
Simon MoandGitHub ac9610b19d [Autoscaler] Precisely match docker HOME (#12020)
* [Autoscaler] Precisely match docker HOME

The current grep will match any env variable keyed by HOME. This will
include some unwanted variables like PYTHONHOME, PROJECT_HOME, etc.
Depending on the order of the environment variable, the subsequent
docker setup command might fail.

* fstring
2020-11-15 11:49:50 -08:00
Richard LiawandGitHub 8b3f79f307 [tune] refactor and add examples (#11931) 2020-11-14 20:43:28 -08:00
dHannaschandGitHub 5891759a3e Clarify get_node_ip_address docstring (#11881) 2020-11-14 15:20:58 -08:00
dHannaschandGitHub 9fbeefd604 Distinguish a bad --redis-password from any other Redis error (#11893) 2020-11-13 17:39:44 -06:00
Eric LiangandGitHub 4f5d6274af [docs] Add links to Ray design patterns whitepaper (#12014)
* update

* update
2020-11-13 14:16:51 -08:00
Edward OakesandGitHub 8bcb0bddc9 [serve] Fix API calls in global README (#12015) 2020-11-13 16:05:00 -06:00
dHannaschandGitHub effa553077 [Doc] Explain how to know whether RAY_BACKEND_LOG_LEVEL worked (#12010)
* Fix broken link to nonexistent Temporary Files page.

* How to know that RAY_BACKEND_LOG_LEVEL worked.

* Reference the definition of DEBUG in case it changes.
2020-11-13 14:02:57 -08:00
Simon MoandGitHub 277558895d [Serve] Introduce Long Polling (#11905) 2020-11-13 13:17:20 -08:00
Eric LiangandGitHub 00ef1179c0 [object spilling] Autocreate dir if not exists (#11999) 2020-11-13 12:13:06 -08:00
Ian RodneyandGitHub f936ea35fe [hotfix] Fix ResourceDemandScheduler (#11996)
* [hotfix] Fix ResourceDemandScheduler

* fix test_autoscaler
2020-11-13 00:42:16 -08:00
SangBin ChoandGitHub f6f9b15299 . (#11998) 2020-11-12 21:33:00 -08:00
Ian RodneyandGitHub 3b56a1a522 [docker] auto-populate shared memory size (#11953) 2020-11-12 17:22:42 -08:00
Michael LuoandGitHub 59bc1e6c09 [RLLib] MAML extension for all models except RNNs (#11337) 2020-11-12 16:51:40 -08:00
Barak MichenerandGitHub 272edcca94 [ray_client]: Implement function calls (#11922) 2020-11-12 16:49:34 -08:00
Eric LiangandGitHub a6a8e777f3 [autoscaler] Interpret autoscaling_speed as 1/x-1 of previous target util fraction (#11961)
* tweak

* update
2020-11-12 16:23:50 -08:00
Sven MikaandGitHub 0bd69edd71 [RLlib] Trajectory view API: enable by default for ES and ARS (#11826) 2020-11-12 10:33:10 -08:00
Michael LuoandGitHub 6e6c680f14 MBMPO Cartpole (#11832)
* MBMPO Cartpole Done

* Added doc
2020-11-12 10:30:41 -08:00
Ian RodneyandGitHub 9254de0b02 [autoscaler] Fix custom node resources on head (#11896) 2020-11-12 10:30:04 -08:00
Gekho457andGitHub ad639f12d8 [autoscaler/k8s] Preliminary k8s operator (#11929) 2020-11-12 11:58:02 -06:00
Gabriele OliaroandGitHub 4744ed01f7 Queueing non-actor tasks at the workers (#11051)
* separated adding tasks to queue and executing them (worker side)

* linting

* first review

* second rev

* rev3, all tests passing locally

* linting

* rev4

* linting

* finished rev4, all tests passing locally (mac)

* rev4, all tests passing locally

* linting

* rev5

* bug fix

* hopefully fixed build

* nvm

* ptr cast

* linting

* no special treatment for actor creation tasks
2020-11-12 12:44:13 -05:00
02c02369ca [tune] Fix hpo randint limits (#11946)
Co-authored-by: Sumanth Ratna <sumanthratna@gmail.com>
2020-11-12 08:45:49 -08:00
Kristian HartikainenandGitHub 07f401d99d [tune] Fix unflatten dict (#11948) 2020-11-12 08:43:15 -08:00
Lee moon sooandGitHub 9920933e31 [docker] Support non-root container (#11407) 2020-11-12 08:41:50 -08:00
Sven MikaandGitHub 62c7ab5182 [RLlib] Trajectory view API: Enable by default for PPO, IMPALA, PG, A3C (tf and torch). (#11747) 2020-11-12 16:27:34 +01:00