Commit Graph

5930 Commits

Author SHA1 Message Date
Alex Wu 0f168bf2ef [hotfix] Use ref in WorkerPool::TryKillingIdleWorkers (#11017) 2020-09-24 17:23:56 -07:00
Amog Kamsetty 3716fb1ca9 [Ray SGD] Fix hotfix test (#11015) 2020-09-24 14:14:03 -07:00
Amog Kamsetty 07bdf062b9 [Ray SGD] [Hotfix] Worker group hotfix (#11008) 2020-09-24 12:21:30 -07:00
SangBin Cho 8c241d5f1d [Core] Use node ip address properly in ray.init (#10829)
* Fix.

* Addressed code review.

* Addressed code review.
2020-09-24 11:44:52 -07:00
Ameer Haj Ali 4ac58d54d6 prepare for head node (#10997)
Co-authored-by: Ameer Haj Ali <ameerhajali@ameers-mbp.lan>
2020-09-24 11:18:38 -07:00
Kai Fricke d9c4dea7cf [tune] strict metric checking (#10972) 2020-09-24 10:00:48 -07:00
SangBin Cho 5e6b887f2d [Placement Group] Capture Child Task Part 1 (#10968)
* In progress.

* In progers.

* Done.

* Addressed code review.

* Increase timeout to make a test less flaky.

* Addressed code review.

* Addressed code review.
2020-09-24 09:02:03 -07:00
Keqiu Hu 46a560e876 [cli][ray] ray start should error by default if there's already an instance running (#10826) 2020-09-24 10:29:59 -05:00
chaokunyang 842861b4fc [Streaming] refine streaming tests sleep condition (#10991) 2020-09-24 17:06:55 +08:00
Amog Kamsetty f42ab54112 [Docs] [Tune] Fix Tune Quick Start docs (#10996) 2020-09-24 00:28:01 -07:00
SongGuyang f9b040db52 add log-dir to new dashboard (#10885) 2020-09-24 13:40:37 +08:00
DK.Pino 4fa6523e4e [Core] Remove unnecessary if judgment (#10971)
* Remove unnecessary if judgment

* format code style
2020-09-23 21:24:11 -07:00
fangfengbin 2a79571c29 [Placement Group] Optimize log (#10974)
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-09-23 20:28:08 -07:00
Kai Yang b251a445dd [Core] Fix maximum_startup_concurrency caused by AnnounceWorkerPort (#10853)
* Fix maximum_startup_concurrency caused by AnnounceWorkerPort

* Address comment

* Update src/ray/raylet/worker_pool.h

Co-authored-by: Eric Liang <ekhliang@gmail.com>

Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-09-23 20:27:44 -07:00
Amog Kamsetty 52e1495e30 [Ray SGD] TorchTrainable pre 0.8.7 deprecation warning (#10984)
* torch trainable add pre 0.8.7 backwards compat

* raise instead

* Update python/ray/util/sgd/torch/torch_trainer.py
2020-09-23 18:19:43 -07:00
Ian Rodney 4c3f09094a [docs] redis-port -> port (#10937) 2020-09-23 17:04:13 -07:00
SangBin Cho cebab8886e [Placement group] Refine doc (#10922) 2020-09-23 16:26:32 -07:00
Alex Wu 295782d411 [New Scheduler] Refactor cluster resource scheduler (#10938) 2020-09-23 15:46:31 -07:00
Eric Liang ecdaaffc67 add large data warning (#10957) 2020-09-23 15:46:06 -07:00
Allen 567009d5fd [Autoscaler] Fix k8s command runner when command fails (#10966)
Co-authored-by: Allen Yin <allenyin@anyscale.io>
2020-09-23 13:25:49 -07:00
SangBin Cho 7931b6ce2e Fix placement group bug failing in release test (#10944) 2020-09-23 12:37:28 -07:00
Kai Fricke 5921e87ecd [tune] Only add new trial when there is no pending trial (#10979) 2020-09-23 11:08:12 -07:00
Amog Kamsetty 7dbd0ff824 fix example (#10964) 2020-09-23 10:33:19 -07:00
fangfengbin a260e66016 [Placement Group]Fix CommitResources crash bug (#10951) 2020-09-23 17:24:53 +08:00
SangBin Cho 390107b6cb [Core] Allow to pass node ip address to gcs server. (#10946)
* Allow to pass node ip address to gcs server.

* Fix.

* Addressed code review.

* Fixed an error.

* Addressed code review.
2020-09-23 01:52:26 -07:00
Michael Luo ba5a3ae9e2 Enable vtrace by default (#10962) 2020-09-22 22:18:21 -07:00
Lee moon soo df4c3abe30 [autoscaler] Staroid node provider (#10956) 2020-09-22 21:25:29 -07:00
Amog Kamsetty 4872ffb44c [Tune] Upgrade Tune tests to TF v2.2 (#10963) 2020-09-22 18:30:05 -07:00
Simon Mo 7fbe076813 [Serve] Unwrap Flask Request from ServeHandle (#10845) 2020-09-22 12:44:23 -07:00
Simon Mo 970fc37173 [Serve] Update architecture.svg (#10754) 2020-09-22 12:43:02 -07:00
Simon Mo 3c1a7c2954 [Doc][Serve] Update middleware docs for serve.client (#10819) 2020-09-22 11:03:32 -07:00
Kai Yang 864d1d2b59 [Core] Multi-tenancy: Kill idle workers in FIFO order (#10597)
* Kill idle workers in FIFO order

* Update test

* minor update

* Address comments

* fix after merge

* fix worker_pool_test
2020-09-22 10:59:11 -07:00
Lee moon soo 1deb281ea6 [docker] Add $GPU to image tag name (#10909) 2020-09-22 10:19:53 -07:00
architkulkarni 67c653c053 [Serve] Only install dataclasses on Python 3.6 (#10936) 2020-09-22 09:39:39 -07:00
Kai Fricke 2d16ab2e16 [tune] Remove unnecessary wandb group parameter (#10950) 2020-09-22 09:36:51 -07:00
Sumanth Ratna 770c3633f0 Update max_failures kwarg docstring (#10953) 2020-09-22 09:02:15 -07:00
bermaker 273015814d [Java Worker]Add a resource checker for java worker creation (#10948)
Co-authored-by: Kai Yang <kfstorm@outlook.com>
2020-09-22 22:00:28 +08:00
SangBin Cho e3b4850224 [Placement group] Release test (#10924)
* Done.

* Lint.

* Addressed code review.
2020-09-22 00:49:04 -07:00
SangBin Cho 9d205cda86 [Tests] Fix flaky test_failures by using semaphore instead of sleep (#10942)
* Use semaphore to avoid timing issues.

* Addressed code review.
2020-09-21 23:39:49 -07:00
Eric Liang daa03ba6e6 [rllib] Add execution module to package ref (#10941)
* add init

* add

* update
2020-09-21 23:03:06 -07:00
fangfengbin 1cc4543048 [GCS]Limit the number of profile table (#10888)
* add part code

* add part code

* fix compile bug

* fix compile bug

* fix review comments

Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-09-21 21:53:42 -07:00
internetcoffeephone 840fb5543b Change get_action_shape so that it uses the dtype of the Discrete object, rather than overwriting it with tf.int64. (#8424) 2020-09-21 17:08:31 -07:00
Kai Fricke 6247740b94 [tune] sort running trials to top in status table (#10926)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-21 13:39:51 -07:00
Kai Fricke 50d63b8077 [tune] update pt tutorial docs (#10925)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-21 13:33:37 -07:00
Amog Kamsetty d1d4743702 [Ray SGD] FP16 Hotfix (#10931) 2020-09-21 13:10:10 -07:00
Richard Liaw b0ca70f628 [tune+core] tune lifecycle and starting ray guide (#10813) 2020-09-21 11:27:50 -07:00
mvindiola1 2b893d1bb5 fix incorrect critic loss in TD3 (#10775)
Co-authored-by: Manny Vindiola <manuel.m.vindiola.civ@mail.mil>
2020-09-20 20:01:51 -07:00
fangfengbin 3e94c690c7 Fix flaky placement group test bug (#10915)
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
2020-09-20 19:50:55 -07:00
Sven Mika d7c42d6d92 [RLlib] Unity blogpost final fixes. (#10894) 2020-09-20 14:13:20 +02:00
Sven Mika 805dad3bc4 [RLlib] SAC algo cleanup. (#10825) 2020-09-20 11:27:02 +02:00