wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-12 05:45:11 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,080 Commits 36 Branches 42 Tags
aec03656d5b3c90b17152afd037e7257e6ced46e
Commit Graph

179 Commits

Author SHA1 Message Date
Alex Wu 734629b4ea Ssh command format (#7176) 2020-02-17 14:15:42 -08:00
Richard Liaw 52d9189d5d [autoscaler] port-forward for attach + redis_port (#7145) 
* port-forward

* fixport

* force redis port in init mode

* test

* Update python/ray/tests/test_ray_init.py
 2020-02-14 15:17:00 -08:00
Maksim Smolin 4139e02f01 [autoscaler] Add `--all-nodes` option to rsync-up (#7065) 
* Add option to sync workers to rsync-up

* Format

* Rename --sync-workers to --all-nodes
 2020-02-10 16:27:59 -08:00
Alex Wu 3f99be8dad Add 'ray dashboard' command (#6959) 2020-02-10 12:55:21 -08:00
Eric Liang 37053443b4 Restore set omp (#7051) 2020-02-04 15:02:23 -08:00
Philipp Moritz cc43c9c1a2 Increase limit for autoscaler keys (#7007) 2020-02-01 22:29:40 -08:00
Eric Liang 8b4b49662b Force OMP_NUM_THREADS=1 if unset (#6998) 
* force omp

* update

* set

* workers

* link
 2020-02-01 11:46:11 -08:00
Alex Wu d9a2294298 Ssh identities only (#6931) 2020-01-27 17:01:21 -06:00
Richard Liaw e0078a0d78 [autoscaler][minor] default -> latest_dlami (#6922) 
* config

* latest

* Update python/ray/autoscaler/aws/config.py
 2020-01-27 14:34:07 -08:00
Daniel Edgecumbe e516c50745 [autoscaler]: Kill workers if the monitor raises an exception (#3977) 
Co-authored-by: CJosephides <cjosephides@gmail.com>
 2020-01-23 14:12:52 -06:00
Richard Liaw 2b0e93586f [autoscaler] Auto-replace "DEFAULT" with most recent DLAMI (#6848) 
* try_this

* fix

* actual fix

* default
 2020-01-21 13:54:04 -08:00
Sven 60d4d5e1aa Remove future imports (#6724) 
* Remove all __future__ imports from RLlib.

* Remove (object) again from tf_run_builder.py::TFRunBuilder.

* Fix 2xLINT warnings.

* Fix broken appo_policy import (must be appo_tf_policy)

* Remove future imports from all other ray files (not just RLlib).

* Remove future imports from all other ray files (not just RLlib).

* Remove future import blocks that contain `unicode_literals` as well.
Revert appo_tf_policy.py to appo_policy.py (belongs to another PR).

* Add two empty lines before Schedule class.

* Put back __future__ imports into determine_tests_to_run.py. Fails otherwise on a py2/print related error.
 2020-01-09 00:15:48 -08:00
Robert Nishihara 39a3459886 Remove (object) from class declarations. (#6658) 2020-01-02 17:42:13 -08:00
Robert Nishihara d2c6457832 Remove public facing references to --redis-address. (#6631) 2019-12-31 13:21:53 -08:00
Philipp Moritz 735f282494 Use 0.9.0.dev0 as the version tag (#6630) 2019-12-30 10:14:07 -08:00
Robert Nishihara 8724e5ffd5 Start WebUI by default. (#6493) 2019-12-27 13:49:07 -08:00
Eric Liang 1a1324d2a2 Bump version from 0.8.0.dev6 -> 0.9.0.dev (#6508) 2019-12-16 23:57:42 -08:00
Mitchell Stern b7d23405fe [Dashboard] Change default port from 8080 to 8265 (#6503) 
* [Dashboard] Change default port from 8080 to 8265

* Revise order of imports in pip install setup command
 2019-12-16 14:25:23 -08:00
Edward Oakes f63b64310a Bump version to 0.8.0.dev7 (#6303) 2019-12-05 18:33:54 -08:00
Edward Oakes dff6017272 Fix "failed to create head node" issue (#6304) 
* Fix failed to create head node issue

* comments
 2019-12-02 15:22:00 -08:00
Philipp Moritz fc655acfee Fix linting on master branch (#6174) 2019-11-16 10:02:58 -08:00
Adam Gleave e8cce3fdd4 [autoscaler]: automatically pull new docker image (#6111) 
* Docker: automatically pull new image

* Fix missing value in schema

* Address review comments
 2019-11-15 21:26:28 -08:00
Edward Oakes 385783fcec Ray on YARN + Skein Documentation (#6119) 2019-11-14 15:06:05 -08:00
Simon Mo c75ada9e04 [Autoscaler][K8s] Enforce memory limit in k8s yaml (#6138) 
* Enforce memory limit in k8s yaml

* Update python/ray/autoscaler/kubernetes/example-full.yaml

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

* Line wrap
 2019-11-11 14:06:34 -08:00
Adam Gleave 01aee8d970 [autoscaler] Retry creating EC2 instances in new AZ (#6129) 2019-11-09 19:44:27 -08:00
Philipp Moritz 29eee7f970 Forward multiple ports for autoscaler (#5893) 2019-10-18 16:50:46 -07:00
Peter Schafhalter 6c11b534c8 [Autoscaler] Update AWS Deep Learning AMI to version 24.3 (#5932) 2019-10-16 16:50:54 -07:00
Eric Liang 69d5c1b53a remove evil redirects (#5919) 2019-10-14 19:41:04 -07:00
Richard Liaw 20c0cdee4f [autoscaler] Worker-Head termination + Better Scale-up message (#5909) 2019-10-14 10:37:50 -07:00
Edward Oakes abbfe7392f Bump dev version to 0.8.0.dev6 (#5906) 2019-10-14 11:36:13 +01:00
Richard Liaw 0f24509c30 [autoscaler] uptime redirect fix (#5907) 
* small change

* comment
 2019-10-13 23:25:15 +01:00
Edward Oakes 6eaa8e31fa [autoscaler] Revert to double-spawning updater threads (#5903) 
* [autoscaler] Revert to double-spawning threads

* Use log prefix

* add comment
 2019-10-13 20:00:06 +01:00
Eric Liang 0e8c3c0346 Don't wrap RayError with RayTaskError (#5870) 2019-10-11 11:00:08 -07:00
Edward Oakes 779f91523b [autoscaler] Fix quoting (#5891) 2019-10-11 00:40:26 -07:00
Robert Nishihara 523c764c25 Python 2 compatibility. (#5887) 2019-10-10 19:09:25 -07:00
Edward Oakes 972dddd776 [autoscaler] Kubernetes autoscaler backend (#5492) 
* Add Kubernetes NodeProvider to autoscaler

* Split off SSHCommandRunner

* Add KubernetesCommandRunner

* Cleanup

* More config options

* Check if auth present

* More auth checks

* Better output

* Always bootstrap config

* All working

* Add k8s-rsync comment

* Clean up manual k8s examples

* Fix up submit.yaml

* Automatically configure permissisons

* Fix get_node_provider arg

* Fix permissions

* Fill in empty auth

* Remove ray-cluster from this PR

* No hard dep on kubernetes library

* Move permissions into autoscaler config

* lint

* Fix indentation

* namespace validation

* Use cluster name tag

* Remove kubernetes from setup.py

* Comment in example configs

* Same default autoscaling config as aws

* Add Kubernetes quickstart

* lint

* Revert changes to submit.yaml (other PR)

* Install kubernetes in travis

* address comments

* Improve autoscaling doc

* kubectl command in setup

* Force use_internal_ips

* comments

* backend env in docs

* Change namespace config

* comments

* comments

* Fix yaml test
 2019-10-03 10:17:00 -07:00
Eric Liang 493364d3bd [autoscaler] Add unit tests for stopped node caching, fix flaky tests (#5793) 2019-09-27 22:36:09 -07:00
Eric Liang b5da32df78 Bump Ray version in documentation to dev5 (#5794) 2019-09-27 00:19:17 -07:00
Mitchell Stern 98dcc1d440 [Dashboard] Add initial version of new dashboard (#5730) 2019-09-23 08:50:40 -07:00
Eric Liang 56ab9a00bb [autoscaler] cache stopped nodes, no screen on attach (#5741) 2019-09-22 17:30:35 -07:00
Eric Liang 3ed18d0b59 Fix edge case in autoscaler with poor bin packing (#5702) 
* fix edge case

* fix for general case
 2019-09-13 11:46:10 -07:00
Eric Liang 2fdefe19b7 Take into account queue length in autoscaling (#5684) 2019-09-11 11:31:35 -07:00
Robert Nishihara 93e103135b Update doc versions from 0.8.0.dev3 to 0.8.0.dev4. (#5585) 2019-08-29 22:42:57 -07:00
Eric Liang d20696300e Fix autoscaler format string for memory (#5542) 
* add format string

* fix cast
 2019-08-26 23:25:11 -07:00
Philipp Moritz cf98b1bb13 [autoscaler] Fix ssh control path length issue (#5476) 2019-08-19 16:18:08 -07:00
Simon Mo 18f1e904de Bump 0.8.0.dev2 -> 0.8.0.dev3 (#5409) 2019-08-09 11:37:19 -07:00
Kristian Hartikainen 1345802c39 [autoscaler] Change sys.exit(1) in update ssh_cmd (#5266) 2019-07-31 13:45:05 -07:00
Eric Liang 6f2c5b2819 Revert "[autoscaler] Clean up error messages on setup failure (#5210)" (#5299) 
This reverts commit 7fc15dbf7f.
 2019-07-27 16:53:47 -07:00
Richard Liaw b4823d63c6 [autoscaler] Local YAML readability (#5290) 2019-07-27 12:51:50 -07:00
Daniel Edgecumbe 06fec63c87 [autoscaler] Add a 'request_cores' function for manual autoscaling (#4754) 2019-07-26 17:14:45 -07:00