Edward Oakes and GitHub
6eaa8e31fa
[autoscaler] Revert to double-spawning updater threads ( #5903 )
...
* [autoscaler] Revert to double-spawning threads
* Use log prefix
* add comment
2019-10-13 20:00:06 +01:00
Eric Liang and GitHub
0e8c3c0346
Don't wrap RayError with RayTaskError ( #5870 )
2019-10-11 11:00:08 -07:00
Edward Oakes and Philipp Moritz
779f91523b
[autoscaler] Fix quoting ( #5891 )
2019-10-11 00:40:26 -07:00
Robert Nishihara and GitHub
523c764c25
Python 2 compatibility. ( #5887 )
2019-10-10 19:09:25 -07:00
Edward Oakes and GitHub
972dddd776
[autoscaler] Kubernetes autoscaler backend ( #5492 )
...
* Add Kubernetes NodeProvider to autoscaler
* Split off SSHCommandRunner
* Add KubernetesCommandRunner
* Cleanup
* More config options
* Check if auth present
* More auth checks
* Better output
* Always bootstrap config
* All working
* Add k8s-rsync comment
* Clean up manual k8s examples
* Fix up submit.yaml
* Automatically configure permissisons
* Fix get_node_provider arg
* Fix permissions
* Fill in empty auth
* Remove ray-cluster from this PR
* No hard dep on kubernetes library
* Move permissions into autoscaler config
* lint
* Fix indentation
* namespace validation
* Use cluster name tag
* Remove kubernetes from setup.py
* Comment in example configs
* Same default autoscaling config as aws
* Add Kubernetes quickstart
* lint
* Revert changes to submit.yaml (other PR)
* Install kubernetes in travis
* address comments
* Improve autoscaling doc
* kubectl command in setup
* Force use_internal_ips
* comments
* backend env in docs
* Change namespace config
* comments
* comments
* Fix yaml test
2019-10-03 10:17:00 -07:00
Eric Liang and GitHub
493364d3bd
[autoscaler] Add unit tests for stopped node caching, fix flaky tests ( #5793 )
2019-09-27 22:36:09 -07:00
Eric Liang and Robert Nishihara
b5da32df78
Bump Ray version in documentation to dev5 ( #5794 )
2019-09-27 00:19:17 -07:00
Mitchell Stern and Robert Nishihara
98dcc1d440
[Dashboard] Add initial version of new dashboard ( #5730 )
2019-09-23 08:50:40 -07:00
Eric Liang and GitHub
56ab9a00bb
[autoscaler] cache stopped nodes, no screen on attach ( #5741 )
2019-09-22 17:30:35 -07:00
Eric Liang and GitHub
3ed18d0b59
Fix edge case in autoscaler with poor bin packing ( #5702 )
...
* fix edge case
* fix for general case
2019-09-13 11:46:10 -07:00
Eric Liang and GitHub
2fdefe19b7
Take into account queue length in autoscaling ( #5684 )
2019-09-11 11:31:35 -07:00
Robert Nishihara and Philipp Moritz
93e103135b
Update doc versions from 0.8.0.dev3 to 0.8.0.dev4. ( #5585 )
2019-08-29 22:42:57 -07:00
Eric Liang and GitHub
d20696300e
Fix autoscaler format string for memory ( #5542 )
...
* add format string
* fix cast
2019-08-26 23:25:11 -07:00
Philipp Moritz and GitHub
cf98b1bb13
[autoscaler] Fix ssh control path length issue ( #5476 )
2019-08-19 16:18:08 -07:00
Simon Mo and Robert Nishihara
18f1e904de
Bump 0.8.0.dev2 -> 0.8.0.dev3 ( #5409 )
2019-08-09 11:37:19 -07:00
Kristian Hartikainen and Richard Liaw
1345802c39
[autoscaler] Change sys.exit(1) in update ssh_cmd ( #5266 )
2019-07-31 13:45:05 -07:00
Eric Liang and GitHub
6f2c5b2819
Revert "[autoscaler] Clean up error messages on setup failure ( #5210 )" ( #5299 )
...
This reverts commit 7fc15dbf7f
2019-07-27 16:53:47 -07:00
Richard Liaw and GitHub
b4823d63c6
[autoscaler] Local YAML readability ( #5290 )
2019-07-27 12:51:50 -07:00
Daniel Edgecumbe and Richard Liaw
06fec63c87
[autoscaler] Add a 'request_cores' function for manual autoscaling ( #4754 )
2019-07-26 17:14:45 -07:00
Richard Liaw and GitHub
7fc15dbf7f
[autoscaler] Clean up error messages on setup failure ( #5210 )
2019-07-22 11:27:51 -07:00
Richard Liaw and GitHub
3e0ad11ae0
Add heartbeat test + Fix monitor.py ( #5191 )
2019-07-16 21:59:48 -07:00
Richard Liaw and GitHub
b6509f46b0
Update wheels to 0.8.0dev2 ( #5186 )
2019-07-12 17:27:03 -07:00
Richard Liaw and GitHub
1530389822
[tune] Fast Node Recovery ( #5053 )
2019-07-12 13:47:30 -07:00
Kristian Hartikainen and Richard Liaw
3456afdea7
[autoscaler] Fix missing body argument in GCP getIamPolicy #5169
2019-07-11 13:03:51 -07:00
Daniel Edgecumbe and Richard Liaw
eeb67db861
[autoscaler] Log AWS NodeProvider create_instances ( #4998 )
...
* autoscaler: Log on AWS NodeProvider create_instances
* logging
2019-07-08 13:22:26 -07:00
Richard Liaw and Eric Liang
6a14f1a540
[autoscaler] Small fixes for local cluster usability ( #4864 )
2019-07-06 21:55:18 -07:00
1798d4f077
[autoscaler] Add hard kill and monitor commands ( #5082 )
...
* Add hard kill and monitor commands
* better_commands
* Update python/ray/scripts/scripts.py
Co-Authored-By: Kristian Hartikainen <kristian.hartikainen@gmail.com >
2019-07-06 21:52:55 -07:00
Eric Liang and GitHub
445bcb29b0
[hotfix] fix backward compat with older yaml libraries
2019-07-06 20:41:28 -07:00
Brandon Bertelsen and Philipp Moritz
c04b69902c
Updates for #5072 ( #5091 )
2019-07-06 16:05:50 -07:00
904dcf081d
Switch cluster longevity tests to DLAMI, fix ray up verbosity ( #5084 )
...
* fix
* add branch commit
* comments
* Update ci/long_running_tests/.gitignore
Co-Authored-By: Robert Nishihara <robertnishihara@gmail.com >
2019-07-02 00:19:05 -07:00
Qing Wang and GitHub
d9768c1cd2
[hotfix] Fix master's linting ( #5049 )
...
The linting in CI on master always fail.
2019-06-27 20:21:32 +08:00
Daniel Edgecumbe and Philipp Moritz
49c6e81de2
autoscaler/monitor: Kill workers on exception ( #4997 )
2019-06-26 17:59:12 -07:00
Robert Nishihara and Philipp Moritz
6f48992322
Make release stress tests work and improve them. ( #4955 )
2019-06-10 23:04:01 -07:00
Robert Nishihara and GitHub
c3f8fc1c44
Update version number in documentation after release 0.7.0 -> 0.7.1 and 0.8.0.dev0 -> 0.8.0.dev1. ( #4941 )
2019-06-06 17:22:45 -07:00
Richard Liaw and Eric Liang
084b22181e
Fix local cluster yaml ( #4918 )
2019-06-03 08:45:57 +08:00
Robert Nishihara and Philipp Moritz
7a78e1e320
Install bazel in autoscaler development configs. ( #4874 )
2019-05-26 16:13:50 -07:00
Devin Petersohn and Robert Nishihara
a7d01aba9b
Update wheel versions in documentation to 0.8.0.dev0 and 0.7.0. ( #4847 )
2019-05-24 16:49:13 -07:00
Richard Liaw and GitHub
88b45a53d6
[autoscaler] rsync cluster ( #4785 )
2019-05-16 23:11:06 -07:00
Romil Bhardwaj and Robert Nishihara
0421cba4e8
Autoscaler hotfix for #4555 . ( #4653 )
2019-05-08 14:50:52 -07:00
Kristian Hartikainen and Richard Liaw
69da6d0fc8
[autoscaler] Remove unnecessary apt installations in docker commands ( #4577 )
...
* Remove unnecessary apt installations in docker commands
* Add example for different head/worker image in gcp gpu example
* Update gcp gpu example docker image to tf 1.13
* Change the VM sourceImage for gcp/example-full.yaml
* Change the gcp gpu docker VM images for consistency
* Change gcp default project id to be consistent with other examples
2019-04-28 14:58:51 -07:00
Eric Liang and GitHub
47cca971b5
Don't delete files in rsync up, and also shorten timeout ( #4688 )
2019-04-25 12:18:42 -07:00
Andrew Tan and Eric Liang
57af1c6819
Update volume size to 100 ( #4616 )
2019-04-14 11:40:16 -07:00
Zachary Barry and Kristian Hartikainen
3838548356
Custom SSH socket directories ( #4299 )
...
* ssh_control_path added as an auth option.
* revamped default ssh options to take in control path, nodeupdater checks auth config to see if a custom SSH sockets path was specified, otherwise the original hardcoded path is used. control path is now a nodeupdater instance variable
* revert socketdir in auth config and change method for determining dir
* new ssh dir method
* Lint
* ' -> " lint
* changed using USER env to getpass.getuser()
2019-04-13 23:55:41 -07:00
Daniel Edgecumbe and Robert Nishihara
3e1adafbce
[autoscaler] Add an aggressive_autoscaling flag ( #4285 )
2019-04-13 18:44:32 -07:00
justinwyang and Robert Nishihara
e88e706fcc
Enforce quoting style in Travis. ( #4589 )
2019-04-11 14:24:26 -07:00
Kristian Hartikainen and Yuhong Guo
ed02bf11f7
[autoscaler] Lint code that we forgot to lint in #4537 ( #4584 )
...
* Lint code that we forgot to lint in previous PR
* Revert setup command merge
* Lint
* Revert "Revert setup command merge"
This reverts commit 55e1cdb1f256ea51ef66a38730d8f7865f1f5ad1.
* Fix testReportsConfigFailures test
* Minor syntax tweaks
* Lint
2019-04-10 17:01:36 +08:00
Stefan Pantic and Kristian Hartikainen
915486984a
[autoscaler] Add support for separate docker containers on head and worker nodes ( #4537 )
...
* Added support for running different docker containers on clusters
* Remove node specific container names
* Keep old options and expand with node specific configuration
* Optimized imports
* Changed docker fields for autoscaler
* Auto reformat
* Updated comments
* Updated condition
* Run linter
* Updated example
* Changed condition for docker images, updated examples
* Removed duplicate line
* Fixed setup_commands
* Update autoscaler.py
* fix_better_image
2019-04-07 16:51:32 -07:00
Yuhong Guo and Philipp Moritz
c2349cf12d
Remove local/global_scheduler from code and doc. ( #4549 )
2019-04-03 17:05:09 -07:00
Philipp Moritz and Robert Nishihara
b0f6ddf6d1
Remove CMake files ( #4493 )
2019-04-02 22:17:33 -07:00
Toanngo and Eric Liang
dffe19c59c
Update GCP gpu image ( #4524 )
2019-03-31 01:01:22 -07:00
