wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-12 14:40:16 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,242 Commits 36 Branches 42 Tags
2fdefe19b787b373f35b814208e67ee2eff5f0a1
Commit Graph

138 Commits

Author SHA1 Message Date
Eric Liang 2fdefe19b7 Take into account queue length in autoscaling (#5684) 2019-09-11 11:31:35 -07:00
Robert Nishihara 93e103135b Update doc versions from 0.8.0.dev3 to 0.8.0.dev4. (#5585) 2019-08-29 22:42:57 -07:00
Eric Liang d20696300e Fix autoscaler format string for memory (#5542) 
* add format string

* fix cast
 2019-08-26 23:25:11 -07:00
Philipp Moritz cf98b1bb13 [autoscaler] Fix ssh control path length issue (#5476) 2019-08-19 16:18:08 -07:00
Simon Mo 18f1e904de Bump 0.8.0.dev2 -> 0.8.0.dev3 (#5409) 2019-08-09 11:37:19 -07:00
Kristian Hartikainen 1345802c39 [autoscaler] Change sys.exit(1) in update ssh_cmd (#5266) 2019-07-31 13:45:05 -07:00
Eric Liang 6f2c5b2819 Revert "[autoscaler] Clean up error messages on setup failure (#5210)" (#5299) 
This reverts commit 7fc15dbf7f.
 2019-07-27 16:53:47 -07:00
Richard Liaw b4823d63c6 [autoscaler] Local YAML readability (#5290) 2019-07-27 12:51:50 -07:00
Daniel Edgecumbe 06fec63c87 [autoscaler] Add a 'request_cores' function for manual autoscaling (#4754) 2019-07-26 17:14:45 -07:00
Richard Liaw 7fc15dbf7f [autoscaler] Clean up error messages on setup failure (#5210) 2019-07-22 11:27:51 -07:00
Richard Liaw 3e0ad11ae0 Add heartbeat test + Fix monitor.py (#5191) 2019-07-16 21:59:48 -07:00
Richard Liaw b6509f46b0 Update wheels to 0.8.0dev2 (#5186) 2019-07-12 17:27:03 -07:00
Richard Liaw 1530389822 [tune] Fast Node Recovery (#5053) 2019-07-12 13:47:30 -07:00
Kristian Hartikainen 3456afdea7 [autoscaler] Fix missing body argument in GCP getIamPolicy #5169 2019-07-11 13:03:51 -07:00
Daniel Edgecumbe eeb67db861 [autoscaler] Log AWS NodeProvider create_instances (#4998) 
* autoscaler: Log on AWS NodeProvider create_instances

* logging
 2019-07-08 13:22:26 -07:00
Richard Liaw 6a14f1a540 [autoscaler] Small fixes for local cluster usability (#4864) 2019-07-06 21:55:18 -07:00
Richard Liaw 1798d4f077 [autoscaler] Add hard kill and monitor commands (#5082) 
* Add hard kill and monitor commands

* better_commands

* Update python/ray/scripts/scripts.py

Co-Authored-By: Kristian Hartikainen <kristian.hartikainen@gmail.com>
 2019-07-06 21:52:55 -07:00
Eric Liang 445bcb29b0 [hotfix] fix backward compat with older yaml libraries 2019-07-06 20:41:28 -07:00
Brandon Bertelsen c04b69902c Updates for #5072 (#5091) 2019-07-06 16:05:50 -07:00
Eric Liang 904dcf081d Switch cluster longevity tests to DLAMI, fix ray up verbosity (#5084) 
* fix

* add branch commit

* comments

* Update ci/long_running_tests/.gitignore

Co-Authored-By: Robert Nishihara <robertnishihara@gmail.com>
 2019-07-02 00:19:05 -07:00
Qing Wang d9768c1cd2 [hotfix] Fix master's linting (#5049) 
The linting in CI on master always fail.
 2019-06-27 20:21:32 +08:00
Daniel Edgecumbe 49c6e81de2 autoscaler/monitor: Kill workers on exception (#4997) 2019-06-26 17:59:12 -07:00
Robert Nishihara 6f48992322 Make release stress tests work and improve them. (#4955) 2019-06-10 23:04:01 -07:00
Robert Nishihara c3f8fc1c44 Update version number in documentation after release 0.7.0 -> 0.7.1 and 0.8.0.dev0 -> 0.8.0.dev1. (#4941) 2019-06-06 17:22:45 -07:00
Richard Liaw 084b22181e Fix local cluster yaml (#4918) 2019-06-03 08:45:57 +08:00
Robert Nishihara 7a78e1e320 Install bazel in autoscaler development configs. (#4874) 2019-05-26 16:13:50 -07:00
Devin Petersohn a7d01aba9b Update wheel versions in documentation to 0.8.0.dev0 and 0.7.0. (#4847) 2019-05-24 16:49:13 -07:00
Richard Liaw 88b45a53d6 [autoscaler] rsync cluster (#4785) 2019-05-16 23:11:06 -07:00
Romil Bhardwaj 0421cba4e8 Autoscaler hotfix for #4555. (#4653) 2019-05-08 14:50:52 -07:00
Kristian Hartikainen 69da6d0fc8 [autoscaler] Remove unnecessary apt installations in docker commands (#4577) 
* Remove unnecessary apt installations in docker commands

* Add example for different head/worker image in gcp gpu example

* Update gcp gpu example docker image to tf 1.13

* Change the VM sourceImage for gcp/example-full.yaml

* Change the gcp gpu docker VM images for consistency

* Change gcp default project id to be consistent with other examples
 2019-04-28 14:58:51 -07:00
Eric Liang 47cca971b5 Don't delete files in rsync up, and also shorten timeout (#4688) 2019-04-25 12:18:42 -07:00
Andrew Tan 57af1c6819 Update volume size to 100 (#4616) 2019-04-14 11:40:16 -07:00
Zachary Barry 3838548356 Custom SSH socket directories (#4299) 
* ssh_control_path added as an auth option.

* revamped default ssh options to take in control path, nodeupdater checks auth config to see if a custom SSH sockets path was specified, otherwise the original hardcoded path is used. control path is now a nodeupdater instance variable

* revert socketdir in auth config and change method for determining dir

* new ssh dir method

* Lint

* ' -> " lint

* changed using USER env to getpass.getuser()
 2019-04-13 23:55:41 -07:00
Daniel Edgecumbe 3e1adafbce [autoscaler] Add an aggressive_autoscaling flag (#4285) 2019-04-13 18:44:32 -07:00
justinwyang e88e706fcc Enforce quoting style in Travis. (#4589) 2019-04-11 14:24:26 -07:00
Kristian Hartikainen ed02bf11f7 [autoscaler] Lint code that we forgot to lint in #4537 (#4584) 
* Lint code that we forgot to lint in previous PR

* Revert setup command merge

* Lint

* Revert "Revert setup command merge"

This reverts commit 55e1cdb1f256ea51ef66a38730d8f7865f1f5ad1.

* Fix testReportsConfigFailures test

* Minor syntax tweaks

* Lint
 2019-04-10 17:01:36 +08:00
Stefan Pantic 915486984a [autoscaler] Add support for separate docker containers on head and worker nodes (#4537) 
* Added support for running different docker containers on clusters

* Remove node specific container names

* Keep old options and expand with node specific configuration

* Optimized imports

* Changed docker fields for autoscaler

* Auto reformat

* Updated comments

* Updated condition

* Run linter

* Updated example

* Changed condition for docker images, updated examples

* Removed duplicate line

* Fixed setup_commands

* Update autoscaler.py

* fix_better_image
 2019-04-07 16:51:32 -07:00
Yuhong Guo c2349cf12d Remove local/global_scheduler from code and doc. (#4549) 2019-04-03 17:05:09 -07:00
Philipp Moritz b0f6ddf6d1 Remove CMake files (#4493) 2019-04-02 22:17:33 -07:00
Toanngo dffe19c59c Update GCP gpu image (#4524) 2019-03-31 01:01:22 -07:00
Robert Nishihara c6f12e5219 Update documentation from 0.7.0.dev1 to 0.7.0.dev2. (#4485) 2019-03-26 17:32:53 -07:00
Eric Liang b513c0f498 [autoscaler] Restore error message for setup 2019-03-16 18:00:37 -07:00
Philipp Moritz 39eed24d47 update version from 0.7.0.dev0 to 0.7.0.dev1 (#4282) 2019-03-06 14:43:09 -08:00
Peiren Yang e2e6ef198b [autoscaler] Make commands bash -i to support newer bash (#4181) 
The generated command in autoscaler/updater.py throws non-zero exit status 127 on Ubuntu 18.04.

## Related issue number
Closes #4155, Closes #1444.
 2019-03-03 13:46:07 -08:00
Eric Liang ff6dd8459a [autoscaler] Timeout ssh master connection after 5 minutes 2019-03-02 22:57:22 -08:00
Eric Liang 60dbc771a2 Revert "[autoscaler] Fix redirects, fix submit (#4085)" (#4158) 
This reverts commit acf4d53b55.
 2019-02-25 17:00:59 -08:00
Kristian Hartikainen 524e69a82d [autoscaler] Change the get behavior of node providers' _get_node (#4132) 
* Change the get behavior of GCPNodeProvider._get_node

* Add lock around the GCPNodeProvider._get_node call

* rename nodes

* lint

* Update GCPNodeProvider._get_node to match aws implementation

* assert

* log

* log highest heartbeats

* rename

* bringup to connected

* prune heartbeat times

* fix bringup
 2019-02-24 18:43:35 -08:00
Zachary Barry ae4dd1db76 Custom provider_config options for NodeProvider implementations (#4075) 
* added a key to send custom provider_config options to NodeProvider implementations

* Update autoscaler.py

* Update autoscaler.py
 2019-02-21 21:09:22 -08:00
Daniel Edgecumbe 2e30f7ba38 Add a web dashboard for monitoring node resource usage (#4066) 2019-02-21 00:10:04 -08:00
Richard Liaw acf4d53b55 [autoscaler] Fix redirects, fix submit (#4085) 2019-02-20 21:35:33 -08:00