[autoscaler] Run initialization_commands without a persistent connection (#9020)

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
This commit is contained in:
Ian Rodney
2020-07-06 16:34:59 -07:00
committed by GitHub
co-authored by Richard Liaw Edward Oakes
parent 139d21e068
commit 6fecd3cfce
2 changed files with 92 additions and 39 deletions
+12 -2
View File
@@ -63,8 +63,7 @@ The ``example-full.yaml`` configuration is enough to get started with Ray, but f
InstanceType: p2.8xlarge
**Docker**: Specify docker image. This executes all commands on all nodes in the docker container,
and opens all the necessary ports to support the Ray cluster. It will also automatically install
Docker if Docker is not installed. This currently does not have GPU support.
and opens all the necessary ports to support the Ray cluster.
.. code-block:: yaml
@@ -72,6 +71,17 @@ Docker if Docker is not installed. This currently does not have GPU support.
image: tensorflow/tensorflow:1.5.0-py3
container_name: ray_docker
If Docker is not installed, add the following commands to ``initialization_commands`` to install it.
.. code-block:: yaml
initialization_commands:
- curl -fsSL https://get.docker.com -o get-docker.sh
- sudo sh get-docker.sh
- sudo usermod -aG docker $USER
- sudo systemctl restart docker -f
**Mixed GPU and CPU nodes**: for RL applications that require proportionally more
CPU than GPU resources, you can use additional CPU workers with a GPU head node.