245c0a9e43
[cli] Tests ( #10057 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-08-22 13:29:10 -07:00
Eric Liang and GitHub
0baf992a4f
[hotfix] [autoscaler] Address remaining comments on renaming instance => node ( #10229 )
...
* more renaming
* fix import
2020-08-20 14:37:41 -07:00
Eric Liang and GitHub
85a6876119
[autoscaler] Rename instance_type => node_type, TAG_RAY_INSTANCE_TYPE => TAG_RAY_USER_NODE_TYPE ( #10207 )
2020-08-20 12:27:11 -07:00
Eric Liang and GitHub
538cb802d5
[autoscaler] Refactor multi node type autoscaler config ( #10190 )
2020-08-19 20:46:00 -07:00
Alex Wu and GitHub
0b5d5ec17d
[Autoscaler] Pass custom resources to "ray start" multi instance autoscaling ( #9986 )
2020-08-17 22:34:07 -07:00
Ian Rodney and GitHub
a079f46c25
[autoscaler]/[docker] Cleanup YAMLs & Use RAY docker images ( #10108 )
2020-08-17 09:49:28 -07:00
Maksim Smolin and GitHub
eace94d2dc
[cli] Fix issues with logging unescaped strings ( #9960 )
2020-08-06 14:44:39 -07:00
Ian Rodney and GitHub
b6da7dcef9
Upgrade to v30 and 18.04 on default yamls ( #9917 )
2020-08-05 13:01:14 -07:00
Henk Tillman and GitHub
ead8b86372
Create ~/.ssh if it doesn't already exist ( #9880 )
2020-08-04 14:55:15 -07:00
Alan Guo and GitHub
3506910c5d
[autoscaler] Create worker_file_mounts config ( #9762 )
2020-07-31 14:33:27 -07:00
Alan Guo and GitHub
5831737287
Introduce file_mounts_sync_continuously cluster option ( #9544 )
...
* Separate out file_mounts contents hashing into its own separate hash
Add an option to continuously sync file_mounts from head node to worker nodes:
monitor.py will re-sync file mounts whenver contents change but will only run setup_commands if the config also changes
* add test and default value for file_mounts_sync_continuously
* format code
* Update comments
* Add param to skip setup commands when only file_mounts content changed during monitor.py's update tick
Fixed so setup commands run when ray up is run and file_mounts content changes
* Refactor so that runtime_hash retains previous behavior
runtime_hash is almost identical as before this PR. It is used to determine if setup_commands need to run
file_mounts_contents_hash is an additional hash of the file_mounts content that is used to detect when only file syncing has to occur.
Note: runtime_hash value will have changed from before the PR because we hash the hash of the contents of the file_mounts as a performance optimization
* fix issue with hashing a hash
* fix bug where trying to set contents hash when it wasn't generated
* Fix lint error
Fix bug in command_runner where check_output was no longer returning the output of the command
* clear out provider between tests to get rid of flakyness
* reduce chance of race condition from node_launcher launching a node in the middle of an autoscaler.update call
2020-07-28 00:02:08 -07:00
908c0c630a
[Autoscaler] Command Line Interface improvements ( #9322 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-07-22 12:21:44 -07:00
1e46d4e29f
[Autoscaler] Making bootstrap config part of the node provider interface ( #9443 )
...
* supporting custom bootstrap config for external node providers
* bootstrap config
* renamed config to cluster_config
* lint
* remove 2 args from importer
* complete move of bootstrap to node_provider
* renamed provider_cls
* move imports outside functions
* lint
* Update python/ray/autoscaler/node_provider.py
Co-authored-by: Eric Liang <ekhliang@gmail.com >
* final fixes
* keeping lines to reduce diff
* lint
* lamba config
* filling in -> adding for lint
Co-authored-by: Ameer Haj Ali <ameerhajali@Ameers-MacBook-Pro.local >
Co-authored-by: Eric Liang <ekhliang@gmail.com >
2020-07-16 09:54:20 -07:00
Eric Liang and GitHub
536795ef79
[autoscaler] Initial support for multiple worker types ( #9096 )
...
* wip
* fix
* update
* debug state
* fix
* update
* update
* fix test
* fix
* fix
* update
* fix
* types and docs
* update
2020-06-24 23:08:30 -07:00
Ian Rodney and GitHub
f76552d8db
[autoscaler] Expose cache_stopped_nodes in Example YAML ( #8981 )
2020-06-22 15:02:45 -07:00
Eric Liang and GitHub
a24d117c68
[autoscaler] Refactor code in preparation for multi instance type support ( #8632 )
...
* wip refactor
* add util
* wip
* fix
* fix
* remove
* remove extraneous string type for sg
2020-06-03 12:53:55 -07:00
Patrick Ames and GitHub
76450c8d47
[autoscaler] Honor separate head and worker node subnet IDs ( #8374 )
2020-05-28 18:16:46 -07:00
Max Fitton and GitHub
13231ba63b
Rename redis-port to port and add default ( #8406 )
2020-05-18 13:25:34 -05:00
Thomas Desrosiers and GitHub
ec9357b486
[autoscaler] Fix filesystem permission race conditions ( #8327 )
2020-05-05 17:22:03 -07:00
Richard Liaw and GitHub
5bc6e32c0a
[autoscaler] latest_dlami update ( #8178 )
2020-04-26 00:25:46 -07:00
3c91ff1f63
[autoscaler] Allowing users to provide extra configs for AWS ( #7844 )
...
* Allowing users to provide custom key names & security group inbound rules
* linting
* getting aws credentials passed in
* one more thing
* one more thing part 2
* formatting
* addressing comments
* update
* update
* update
* update
* update
* update
* remove tests
* rerun tests
Co-authored-by: Allen Yin <allenyin@anyscale.io >
2020-04-04 18:36:51 -07:00
Philipp Moritz and GitHub
cc43c9c1a2
Increase limit for autoscaler keys ( #7007 )
2020-02-01 22:29:40 -08:00
Richard Liaw and GitHub
e0078a0d78
[autoscaler][minor] default -> latest_dlami ( #6922 )
...
* config
* latest
* Update python/ray/autoscaler/aws/config.py
2020-01-27 14:34:07 -08:00
Richard Liaw and GitHub
2b0e93586f
[autoscaler] Auto-replace "DEFAULT" with most recent DLAMI ( #6848 )
...
* try_this
* fix
* actual fix
* default
2020-01-21 13:54:04 -08:00
Sven and Eric Liang
60d4d5e1aa
Remove future imports ( #6724 )
...
* Remove all __future__ imports from RLlib.
* Remove (object) again from tf_run_builder.py::TFRunBuilder.
* Fix 2xLINT warnings.
* Fix broken appo_policy import (must be appo_tf_policy)
* Remove future imports from all other ray files (not just RLlib).
* Remove future imports from all other ray files (not just RLlib).
* Remove future import blocks that contain `unicode_literals` as well.
Revert appo_tf_policy.py to appo_policy.py (belongs to another PR).
* Add two empty lines before Schedule class.
* Put back __future__ imports into determine_tests_to_run.py. Fails otherwise on a py2/print related error.
2020-01-09 00:15:48 -08:00
Robert Nishihara and GitHub
d2c6457832
Remove public facing references to --redis-address. ( #6631 )
2019-12-31 13:21:53 -08:00
Philipp Moritz and GitHub
735f282494
Use 0.9.0.dev0 as the version tag ( #6630 )
2019-12-30 10:14:07 -08:00
Robert Nishihara and Philipp Moritz
8724e5ffd5
Start WebUI by default. ( #6493 )
2019-12-27 13:49:07 -08:00
Eric Liang and GitHub
1a1324d2a2
Bump version from 0.8.0.dev6 -> 0.9.0.dev ( #6508 )
2019-12-16 23:57:42 -08:00
Mitchell Stern and Simon Mo
b7d23405fe
[Dashboard] Change default port from 8080 to 8265 ( #6503 )
...
* [Dashboard] Change default port from 8080 to 8265
* Revise order of imports in pip install setup command
2019-12-16 14:25:23 -08:00
Edward Oakes and GitHub
f63b64310a
Bump version to 0.8.0.dev7 ( #6303 )
2019-12-05 18:33:54 -08:00
Adam Gleave and Richard Liaw
e8cce3fdd4
[autoscaler]: automatically pull new docker image ( #6111 )
...
* Docker: automatically pull new image
* Fix missing value in schema
* Address review comments
2019-11-15 21:26:28 -08:00
Adam Gleave and Richard Liaw
01aee8d970
[autoscaler] Retry creating EC2 instances in new AZ ( #6129 )
2019-11-09 19:44:27 -08:00
Peter Schafhalter and Richard Liaw
6c11b534c8
[Autoscaler] Update AWS Deep Learning AMI to version 24.3 ( #5932 )
2019-10-16 16:50:54 -07:00
Richard Liaw and GitHub
20c0cdee4f
[autoscaler] Worker-Head termination + Better Scale-up message ( #5909 )
2019-10-14 10:37:50 -07:00
Edward Oakes and GitHub
abbfe7392f
Bump dev version to 0.8.0.dev6 ( #5906 )
2019-10-14 11:36:13 +01:00
Eric Liang and Robert Nishihara
b5da32df78
Bump Ray version in documentation to dev5 ( #5794 )
2019-09-27 00:19:17 -07:00
Mitchell Stern and Robert Nishihara
98dcc1d440
[Dashboard] Add initial version of new dashboard ( #5730 )
2019-09-23 08:50:40 -07:00
Eric Liang and GitHub
56ab9a00bb
[autoscaler] cache stopped nodes, no screen on attach ( #5741 )
2019-09-22 17:30:35 -07:00
Robert Nishihara and Philipp Moritz
93e103135b
Update doc versions from 0.8.0.dev3 to 0.8.0.dev4. ( #5585 )
2019-08-29 22:42:57 -07:00
Simon Mo and Robert Nishihara
18f1e904de
Bump 0.8.0.dev2 -> 0.8.0.dev3 ( #5409 )
2019-08-09 11:37:19 -07:00
Daniel Edgecumbe and Richard Liaw
06fec63c87
[autoscaler] Add a 'request_cores' function for manual autoscaling ( #4754 )
2019-07-26 17:14:45 -07:00
Richard Liaw and GitHub
b6509f46b0
Update wheels to 0.8.0dev2 ( #5186 )
2019-07-12 17:27:03 -07:00
Richard Liaw and GitHub
1530389822
[tune] Fast Node Recovery ( #5053 )
2019-07-12 13:47:30 -07:00
Daniel Edgecumbe and Richard Liaw
eeb67db861
[autoscaler] Log AWS NodeProvider create_instances ( #4998 )
...
* autoscaler: Log on AWS NodeProvider create_instances
* logging
2019-07-08 13:22:26 -07:00
Robert Nishihara and GitHub
c3f8fc1c44
Update version number in documentation after release 0.7.0 -> 0.7.1 and 0.8.0.dev0 -> 0.8.0.dev1. ( #4941 )
2019-06-06 17:22:45 -07:00
Robert Nishihara and Philipp Moritz
7a78e1e320
Install bazel in autoscaler development configs. ( #4874 )
2019-05-26 16:13:50 -07:00
Devin Petersohn and Robert Nishihara
a7d01aba9b
Update wheel versions in documentation to 0.8.0.dev0 and 0.7.0. ( #4847 )
2019-05-24 16:49:13 -07:00
Andrew Tan and Eric Liang
57af1c6819
Update volume size to 100 ( #4616 )
2019-04-14 11:40:16 -07:00
Daniel Edgecumbe and Robert Nishihara
3e1adafbce
[autoscaler] Add an aggressive_autoscaling flag ( #4285 )
2019-04-13 18:44:32 -07:00
