Commit Graph

3140 Commits

Author SHA1 Message Date
Max Fitton 44fb60b4dd [hotfix] Pin node version (fix linux wheel build) (#11532)
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-10-21 19:10:09 -07:00
Gekho457 155687e0c3 [autoscaler/AWS] Updated AWS Node Provider threading logic (#11422) 2020-10-21 18:42:38 -07:00
Eric Liang 920e4b2ef8 Try to raise ulimit for file descriptors to max allowed; warn if ulimit is still too low (#11515) 2020-10-21 14:29:43 -07:00
Eric Liang e8c77e2847 Remove memory quota enforcement from actors (#11480)
* wip

* fix

* deprecate
2020-10-21 14:29:03 -07:00
Alan Guo 8c82369cad [autoscaler] Add rsync_exclude and rsync_filter options to cluster config (#11512) 2020-10-21 14:28:33 -07:00
Edward Oakes 5d7f271e7d Add --worker-port-list option to ray start (#11481) 2020-10-21 14:46:45 -05:00
Kai Yang 078a22d676 [Core] Allow creating tasks/actors in a detached actor when driver has exited (#11493)
* Allow creating tasks/actors in a detached actor when driver has exited

* lint

* Address comment
2020-10-21 10:45:29 -07:00
Servon aeea168940 [tune] Update for ZOOpt (#11491)
Co-authored-by: Servon <zewen.li@polixir.ai>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-20 23:56:20 -07:00
Allen 2fc3237045 [Dashboard] Update dashboard port checking so that we can instantly reuse the dashboard port (#11487)
Co-authored-by: Allen Yin <allenyin@anyscale.io>
2020-10-20 19:19:50 -07:00
Kai Fricke 6d11fb8bc6 [tune] validate function callable in tune.with_parameters() (#11504) 2020-10-20 16:03:24 -07:00
Simon Mo 2c5cb95b42 [Serve] Get ServeHandle on the same node (#11477) 2020-10-20 10:44:23 -07:00
Max Fitton cdca5af53b Revert "[Dashboard] Turn on New Dashboard by Default (#11321)" (#11502)
This reverts commit f500292d41.
2020-10-20 10:53:10 -05:00
DK.Pino 15cbfae8ad fix cross language ut (#11492) 2020-10-20 14:14:40 +08:00
Kai Fricke ed81010b0d [tune] support hierarchical search spaces for hyperopt (#11431)
* support hierarchical search spaces for hyperopt

* Reduce num samples

* Fix prefix
2020-10-19 16:00:08 -07:00
Ian Rodney acbd12eabf [Docker] Set Docker as the Default (#11416) 2020-10-19 10:53:30 -07:00
Max Fitton f500292d41 [Dashboard] Turn on New Dashboard by Default (#11321) 2020-10-19 12:31:11 -05:00
Servon 202b1859ef [tune] Update ZOOpt to better support the latest Ray (#11462)
Co-authored-by: Servon <zewen.li@polixir.ai>
2020-10-19 09:28:11 -07:00
Lee moon soo 8581dd2fb1 [Autoscaler] Staroid node provider followup improvements (#11408) 2020-10-18 00:26:11 -07:00
Ian Rodney 6d6a536601 [Docker] Fix Docker Stop on Teardown (#11400) 2020-10-16 15:45:33 -07:00
DK.Pino 6233cef22c [Placement Group] Remove useless placement group argument in ray remote (#11389)
* remove useless placement_group argument in @ray_remote

* remove
2020-10-16 14:17:18 -07:00
Gekho457 50be2970dc [autoscaler]Type hints for commands.py and sdk.py. (#11354) 2020-10-16 13:45:36 -07:00
mattearllongshot 049985549b Restore uptime timeout to 5 seconds (#11300) 2020-10-15 17:21:11 -07:00
herve-alanaai 436202bcfd [docs] Fix typos in documentation (#11414) 2020-10-15 17:00:48 -07:00
Ian Rodney afd797b896 [docker] Check for GPUs before setting runtime-nvidia (#11418) 2020-10-15 15:43:09 -07:00
Amog Kamsetty 38eb61442b [SGD] Callback API for SGD+Tune (#11316)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-15 15:22:14 -07:00
Sumanth Ratna 60a4be4a59 [tune] Remove metric and mode kwargs from create_searcher (#11335) 2020-10-14 21:44:36 -07:00
Sumanth Ratna 3fe757391b [tune] Add Basic Variant Generator to search algorithm shim function (#11334)
* Add Basic Variant Generator

* Add 'random' key to SEARCH_ALG_IMPORT

Co-authored-by: Kai Fricke <kai@anyscale.com>

Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-10-14 21:41:47 -07:00
Vishnu Deva 00e0f14c6f [tune] restore trials when sync_on_checkpoint is False (#11355)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-14 19:09:34 -07:00
Kai Fricke f7120d2a18 [tune] Make metrics parameter optional in pytorch lightning integration (#11402) 2020-10-14 17:50:34 -07:00
SangBin Cho 666fcde8ca [Placement group] Input validation (#11152)
* Add a basic input validation.

* Addressed code review.
2020-10-14 13:56:41 -07:00
Ameer Haj Ali a10e36ca04 Make the logging of gc.collect() freed refs appear in DEBUG not INFO (#11353) 2020-10-14 13:14:35 -07:00
Alex Wu 7466ce82df [Autoscaler] Placement group autoscaling (#11243) 2020-10-14 13:11:46 -07:00
Kai Yang abc6126814 [Java] Release actor instance reference when Ray.exitActor() is invoked (#11324) 2020-10-14 13:12:59 +08:00
Simon Mo 866193b01c Fix cluster yaml for serve benchmarks (#11383)
- Separate out single node and multiple node yamls
- Remove cluster_synced_files, somehow it breaks for me
2020-10-13 19:30:18 -07:00
Max Fitton cd9dcfca0d [Dashboard] CPU/GPU usage details in actor pane (#11269) 2020-10-13 20:23:23 -05:00
Amog Kamsetty 933cf6675c [Tune] Changes for Pytorch Lightning 1.0 (#11375) 2020-10-13 15:50:11 -07:00
J Seppänen 63fa0a53a3 [k8s] Fix kubernetes cloud cluster example configuration (#11364) 2020-10-13 12:28:55 -07:00
SangBin Cho 56f69543d0 Try to deflake test_failure (#11293) 2020-10-12 12:03:36 -05:00
Ameer Haj Ali 06fe690682 [autoscaler] Limit max launch concurrency per node type (#11242) 2020-10-12 09:45:52 -07:00
Alex Wu 175fc41fbc [Autoscaler] Account for resource backlog size (#11261) 2020-10-12 09:43:48 -07:00
Simon Mo 0d09a17c64 Skip set_result if the future is done (#11256) 2020-10-11 22:33:58 -07:00
Richard Liaw 56f858ed1a [tune][docs/util] gputil check, docs (#11260)
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-10-10 00:54:31 -07:00
Gekho457 48db6f8858 [autoscaler/k8s] namespace permissions problem (#11270) 2020-10-09 19:22:20 -05:00
Gekho457 92b4059cad Replace read_namespaced_pod_status with read_namespaced_pod (#11278) 2020-10-09 19:21:39 -05:00
Ian Rodney 5ef1784024 [Autoscaler] Fix sdk (#11314)
* Use

* [Hotfix] Make Optional[str] default to None

* Fix TempFile

* context manager (with statement)

* use throughout

* drop try/finally
2020-10-09 12:34:29 -07:00
Kai Fricke b450cb030a [tune] reuse actors for function API (#11230)
Co-authored-by: Kristian Hartikainen <kristian.hartikainen@gmail.com>
2020-10-08 16:15:02 -07:00
Thomas Tumiel 587319debc [tune] move _SCHEDULERS to tune.schedulers and add all available schedulers (#11218)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-08 16:10:23 -07:00
SangBin Cho 6cb00208f7 [Placement Group] Export bundle reservation check method only once. (#11153)
* Export bundle reservation check method only once.

* Addressed code review.
2020-10-08 16:08:28 -07:00
Richard Liaw 74e9647ec3 [tune] deactivate flaky test for now (#11284) 2020-10-08 15:40:04 -07:00
Amog Kamsetty 1027bfd4b8 [Tune, Ray SGD] Update PTL integrations (#11271) 2020-10-08 13:43:07 -07:00