[autoscaler] Experimental support for local / on-prem clusters (#2678)

This adds some experimental (undocumented) support for launching Ray on existing nodes. You have to provide the head ip, and the list of worker ips.

There are also a couple additional utils added for rsyncing files and port-forward.
This commit is contained in:
Eric Liang
2018-08-19 12:43:04 -07:00
committed by GitHub
parent 62d0698097
commit 9473da69bd
10 changed files with 339 additions and 37 deletions
+2
View File
@@ -65,6 +65,8 @@ CLUSTER_CONFIG_SCHEMA = {
"module": (str,
OPTIONAL), # module, if using external node provider
"project_id": (None, OPTIONAL), # gcp project id, if using gcp
"head_ip": (str, OPTIONAL), # local cluster head node
"worker_ips": (list, OPTIONAL), # local cluster worker nodes
},
REQUIRED),