Commit Graph

296 Commits

Author SHA1 Message Date
Ian Rodney 39c598bab0 [docker] No Docker CP if File Mount (#10633) 2020-09-08 10:25:24 -07:00
Richard Liaw 169c3a46de [k8s] Broken Command Interactivity (#10297)
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-07 09:56:41 -07:00
Alex Wu 8906c1a59f [Autoscaler] Demand autoscaler take into account utilized resources (#10464) 2020-09-06 20:54:44 -07:00
Maksim Smolin f38dba09b2 [cli] Support non-interactive logging (#10203)
* add non-interactive logging

* logger

* add formatter support, add flag

* checkpoint

* format

* fix-interactive

* fixup

* fomrmat

* fix

* revert

* fix

* fix

* fix

* fix

* fx

* fix-test

* fix-commands

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-05 15:41:35 -07:00
Maksim Smolin 02efa2549d [cli] Fix colors on light themes (#10577) 2020-09-04 10:45:27 -07:00
PidgeyBE 51df0820de [autoscaler] Fix ingress manifest bug (#10536) 2020-09-04 01:09:16 -05:00
Ian Rodney c54853d45b [Autoscaler] Actually try to catch when docker does not exist (#10549) 2020-09-03 14:00:06 -07:00
Ian Rodney b9633a2b67 [docker] Support multiple node types (#10504) 2020-09-02 18:27:59 -07:00
Vysybyl 6fa0edfbef [gcp] Update config.py for safe dir creation (#9645)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-01 21:41:44 -07:00
Yiran Wang 2b95b613f2 [Autoscaler] Retry create_instances properly in AWSNodeProvider (#10479) 2020-09-01 16:17:11 -07:00
Alex Wu 23bbe0f36a [Autoscaler] Reload config (#10450) 2020-09-01 14:37:04 -07:00
Ian Rodney 283f4d1060 [docker] Use tmp paths for rsync and fix file_mounts on docker (#10368) 2020-09-01 13:14:35 -07:00
Ian Rodney c644650818 [docker] Run docker stop in teardown_cluster (#10407) 2020-09-01 11:25:37 -07:00
PidgeyBE 6917efabc4 [k8s] Replace k8s service name everywhere in ingress manifest (#10445)
Co-authored-by: Pieterjan <pieterjan.soetaert@robovision.eu>
2020-08-31 13:14:40 -07:00
Robert Nishihara 0bba5485d3 [cli] Add prompt command for CLI logger. (#9897)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-31 11:03:53 -07:00
Eric Liang f6a1698bab [autoscaler] Add documentation for multi node type autoscaling (#10405) 2020-08-28 19:57:21 -07:00
Alex Wu b1f3c9e10e [Autoscaler] Fix resource passing bug fix (#10397) 2020-08-28 15:43:18 -07:00
Edward Oakes c3ed403def fix typo (#10382) 2020-08-28 09:57:04 -05:00
Richard Liaw 922bf9f45a [cli] improve error handling, don't swallow errors (#10370) 2020-08-27 17:59:44 -07:00
Alex Wu 76898d4ebc [Autoscaler][hotfix] Remove additionalProperties from available_node_types schema (#10366) 2020-08-27 13:56:44 -07:00
Philipp Moritz b8673e5697 [autoscaler] Make KeyName optional in AWS autoscaler (#10336) 2020-08-27 11:08:44 -07:00
Alex Wu 6d2af33a01 [Autoscaler] Proper resource demand plumbing (#10329) 2020-08-26 23:36:01 -07:00
Ameer Haj Ali 17c8c63e7e Metadata schema (#10328)
* metadata

* Eric

Co-authored-by: Ameer Haj Ali <ameerhajali@Ameers-MacBook-Pro.local>
2020-08-26 15:43:03 -07:00
Richard Liaw 29e8a664c4 [cli] make sure old-style works (#10344) 2020-08-26 15:26:24 -07:00
Ian Rodney dc378a80b7 [autoscaler/docker] Docker Inititialization Revamp (#9515)
* Basic idea

* Small fixes

* dockerize start commands in Command Runner

* Remove run_init from CommandRunnerInterface

* Add Parens

Co-authored-by: Simon Mo <simon.mo@hey.com>

* Cleaning up

* Response to richards comments

* Further small fixes

* Fix Json

* schema format fix

* cleanup

* run more often

* fix indent

* Fix richards responses

* fix ups

* remove docker_commands from schema

* default to list

* fix docker cmd runner test

* lint fix

Co-authored-by: Simon Mo <simon.mo@hey.com>
2020-08-26 10:29:06 -07:00
Alex Wu 9ca159aa0b [Autoscaler] Multi node commands (#10236) 2020-08-25 23:35:38 -07:00
Richard Liaw 6dc22a6d68 [autoscaler] Fix logging regression (#10280) 2020-08-24 14:25:12 -07:00
Eric Liang 4761eacc3e [autoscaler] Also account for head node resources in multi node type autoscaling (#10230) 2020-08-24 10:26:22 -07:00
Ian Rodney f051c2852e [docker] docker cp correctly into container (#10253) 2020-08-24 09:18:34 -07:00
Maksim Smolin 245c0a9e43 [cli] Tests (#10057)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-22 13:29:10 -07:00
Richard Liaw f87669372d [cli] enable log-new-style by default (#10213) 2020-08-21 15:21:43 -07:00
Eric Liang 0baf992a4f [hotfix] [autoscaler] Address remaining comments on renaming instance => node (#10229)
* more renaming

* fix import
2020-08-20 14:37:41 -07:00
Eric Liang 85a6876119 [autoscaler] Rename instance_type => node_type, TAG_RAY_INSTANCE_TYPE => TAG_RAY_USER_NODE_TYPE (#10207) 2020-08-20 12:27:11 -07:00
Eric Liang 538cb802d5 [autoscaler] Refactor multi node type autoscaler config (#10190) 2020-08-19 20:46:00 -07:00
Richard Liaw 2fd59de05d [autoscaler] hotfix - swallowed error for missing yaml (#10212) 2020-08-19 20:02:56 -07:00
Alex Wu b70dce0d02 [autoscaler] Hotfix bad None check (#10196) 2020-08-19 13:27:20 -07:00
Max Fitton 8d06e30a06 [Dashboard] Fix Ray Dashboard command error messages (#10050) 2020-08-18 13:30:51 -05:00
Richard Liaw eacf7dddba update-code (#10106) 2020-08-18 09:28:32 -07:00
Alex Wu 0b5d5ec17d [Autoscaler] Pass custom resources to "ray start" multi instance autoscaling (#9986) 2020-08-17 22:34:07 -07:00
Ian Rodney a079f46c25 [autoscaler]/[docker] Cleanup YAMLs & Use RAY docker images (#10108) 2020-08-17 09:49:28 -07:00
krfricke 8f0f7371a0 [tune] Added Kubernetes syncer and sync client (#10097)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-16 14:09:28 -07:00
Philipp Moritz c7adb464e4 [autoscaler] Fix run_env='host' for initialization commands (#10137) 2020-08-15 15:25:54 -07:00
Philipp Moritz e95f0afe4c [autoscaler] Expand key path for hashing with expanduser (#10125) 2020-08-14 18:50:27 -07:00
Philipp Moritz 6b53df9599 Hash contents of SSH key instead of key path (#10103) 2020-08-14 00:10:31 -07:00
Ian Rodney a252aa29da [docker] Wrap more internal items with run_env="host" (#10078) 2020-08-13 20:35:06 -07:00
Richard Liaw 7a56c3b71a [cli] create_or_update_cluster fix (#10085) 2020-08-13 00:54:45 -07:00
Ameer Haj Ali 82cdcff898 Removing kwargs & SSHOptions args from command runners (#10014) 2020-08-11 15:09:49 -07:00
Maksim Smolin d6226b80bb [cli] CliLogger typing (#10027) 2020-08-11 12:00:57 -07:00
Ian Rodney 98126a84af [docker] Remove port flags (#9992) 2020-08-11 11:43:56 -07:00
Maksim Smolin 40b8e35d61 [cli] New logging for the rest of the ray commands (#9984)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-11 09:58:23 -07:00