Commit Graph

3119 Commits

Author SHA1 Message Date
mattearllongshot 049985549b Restore uptime timeout to 5 seconds (#11300) 2020-10-15 17:21:11 -07:00
herve-alanaai 436202bcfd [docs] Fix typos in documentation (#11414) 2020-10-15 17:00:48 -07:00
Ian Rodney afd797b896 [docker] Check for GPUs before setting runtime-nvidia (#11418) 2020-10-15 15:43:09 -07:00
Amog Kamsetty 38eb61442b [SGD] Callback API for SGD+Tune (#11316)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-15 15:22:14 -07:00
Sumanth Ratna 60a4be4a59 [tune] Remove metric and mode kwargs from create_searcher (#11335) 2020-10-14 21:44:36 -07:00
Sumanth Ratna 3fe757391b [tune] Add Basic Variant Generator to search algorithm shim function (#11334)
* Add Basic Variant Generator

* Add 'random' key to SEARCH_ALG_IMPORT

Co-authored-by: Kai Fricke <kai@anyscale.com>

Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-10-14 21:41:47 -07:00
Vishnu Deva 00e0f14c6f [tune] restore trials when sync_on_checkpoint is False (#11355)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-14 19:09:34 -07:00
Kai Fricke f7120d2a18 [tune] Make metrics parameter optional in pytorch lightning integration (#11402) 2020-10-14 17:50:34 -07:00
SangBin Cho 666fcde8ca [Placement group] Input validation (#11152)
* Add a basic input validation.

* Addressed code review.
2020-10-14 13:56:41 -07:00
Ameer Haj Ali a10e36ca04 Make the logging of gc.collect() freed refs appear in DEBUG not INFO (#11353) 2020-10-14 13:14:35 -07:00
Alex Wu 7466ce82df [Autoscaler] Placement group autoscaling (#11243) 2020-10-14 13:11:46 -07:00
Kai Yang abc6126814 [Java] Release actor instance reference when Ray.exitActor() is invoked (#11324) 2020-10-14 13:12:59 +08:00
Simon Mo 866193b01c Fix cluster yaml for serve benchmarks (#11383)
- Separate out single node and multiple node yamls
- Remove cluster_synced_files, somehow it breaks for me
2020-10-13 19:30:18 -07:00
Max Fitton cd9dcfca0d [Dashboard] CPU/GPU usage details in actor pane (#11269) 2020-10-13 20:23:23 -05:00
Amog Kamsetty 933cf6675c [Tune] Changes for Pytorch Lightning 1.0 (#11375) 2020-10-13 15:50:11 -07:00
J Seppänen 63fa0a53a3 [k8s] Fix kubernetes cloud cluster example configuration (#11364) 2020-10-13 12:28:55 -07:00
SangBin Cho 56f69543d0 Try to deflake test_failure (#11293) 2020-10-12 12:03:36 -05:00
Ameer Haj Ali 06fe690682 [autoscaler] Limit max launch concurrency per node type (#11242) 2020-10-12 09:45:52 -07:00
Alex Wu 175fc41fbc [Autoscaler] Account for resource backlog size (#11261) 2020-10-12 09:43:48 -07:00
Simon Mo 0d09a17c64 Skip set_result if the future is done (#11256) 2020-10-11 22:33:58 -07:00
Richard Liaw 56f858ed1a [tune][docs/util] gputil check, docs (#11260)
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-10-10 00:54:31 -07:00
Gekho457 48db6f8858 [autoscaler/k8s] namespace permissions problem (#11270) 2020-10-09 19:22:20 -05:00
Gekho457 92b4059cad Replace read_namespaced_pod_status with read_namespaced_pod (#11278) 2020-10-09 19:21:39 -05:00
Ian Rodney 5ef1784024 [Autoscaler] Fix sdk (#11314)
* Use

* [Hotfix] Make Optional[str] default to None

* Fix TempFile

* context manager (with statement)

* use throughout

* drop try/finally
2020-10-09 12:34:29 -07:00
Kai Fricke b450cb030a [tune] reuse actors for function API (#11230)
Co-authored-by: Kristian Hartikainen <kristian.hartikainen@gmail.com>
2020-10-08 16:15:02 -07:00
Thomas Tumiel 587319debc [tune] move _SCHEDULERS to tune.schedulers and add all available schedulers (#11218)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-08 16:10:23 -07:00
SangBin Cho 6cb00208f7 [Placement Group] Export bundle reservation check method only once. (#11153)
* Export bundle reservation check method only once.

* Addressed code review.
2020-10-08 16:08:28 -07:00
Richard Liaw 74e9647ec3 [tune] deactivate flaky test for now (#11284) 2020-10-08 15:40:04 -07:00
Amog Kamsetty 1027bfd4b8 [Tune, Ray SGD] Update PTL integrations (#11271) 2020-10-08 13:43:07 -07:00
Lee moon soo bd9619e207 include staroid/example-full.yaml in whl package (#11194) 2020-10-08 11:29:07 -07:00
scottwedge 732cd9901b Fix spelling of occurred (#10792) 2020-10-08 10:55:52 -07:00
SangBin Cho 174bef56d4 [Core] Publish gcs server failure to drivers. (#11265)
* Done.

* Fixed.
2020-10-08 08:59:31 -07:00
Siyuan (Ryans) Zhuang 47b7b76a5a [Example] commands need to be quoted (#11224) 2020-10-07 19:12:42 -07:00
Sumanth Ratna 14d8826e43 Fix overriden typo (#11227) 2020-10-07 19:11:07 -07:00
Ian Rodney b6314dd15c [metrics] Cleanup unused item in Docstring (#11254)
* Use

* remove unused tag
2020-10-07 11:39:38 -07:00
architkulkarni 6676b30eef [Serve] Serve multi node tests (#10980) 2020-10-07 10:57:40 -07:00
Simon Mo 68106425db [Serve] Disable serialization for client and print helpful msg (#11181) 2020-10-07 10:50:30 -07:00
Kai Fricke e58613b5e5 [tune/dashboard] Fix Tune dashboard to work with all trainables (#11232) 2020-10-06 14:03:31 -07:00
Sven Mika ce96b03b07 [RLlib] MB-MPO cleanup (comments, docstrings, type annotations). (#11033) 2020-10-06 20:28:16 +02:00
Gekho457 66e265fdb9 Type annotations added to node_provider.py (#11221) 2020-10-05 22:03:04 -07:00
Alex Wu 8ec044f1f5 [Autoscaler] Remove extra print statement (#11222) 2020-10-05 22:02:23 -07:00
Alex Wu dc7c2a70b8 [Core] Report worker backlog in GCS heartbeat (#11039) 2020-10-05 22:00:44 -07:00
Ameer Haj Ali 518876ef20 Remove test_autoscaler_yaml from windows tests (#11197)
Co-authored-by: Ameer Haj Ali <ameerhajali@ameers-mbp.lan>
Co-authored-by: Alex Wu <alex@anyscale.io>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-10-05 17:07:00 -07:00
Ian Rodney ab30940e50 Use 'mkdir -p' in manylinux (#11219) 2020-10-05 16:18:18 -07:00
Sumanth Ratna 0630242522 [Metrics] Use isinstance for type-checking keys of tags for metrics (#11202)
* Use isinstance instead of type for type-checking keys of tags for metrics

* Fix lint error
2020-10-05 14:24:22 -07:00
Gekho457 aaa8147acb [CI] Add mypy to ci (#11117)
* Add mypy check to format.sh

* format_all() runs mypy check only on specified files
2020-10-05 11:20:45 -07:00
SangBin Cho 80cc161f3e [Placement Group] Report placement group load through heartbeat. (#11129)
* In progress.

* Fix a minor issue.

* Removed unnecessary comments.

* Addressed code review.

* Fix build failure.

* remove stray logs.

* Move global state to a med size test to avoid windows CI breakage.
2020-10-04 16:47:22 -07:00
Ian Rodney 035a4ad0a2 [autoscaler] Update Autoscaler SDK (#11185)
* small sdk addition

* create RAY_AUTOSCALER_CONSTANTS

* better name

* move to private

* better naming
2020-10-03 13:18:01 -07:00
Amog Kamsetty 6325a973a2 [Ray SGD] Support num_steps continue training (#11142) 2020-10-02 23:43:26 -07:00
Ameer Haj Ali 6b86d4d280 Automatically detect CPU, GPU, accelerator_type for AWS (#11147) 2020-10-02 21:16:43 -07:00