wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-07 22:54:09 +08:00
Code Issues Packages Projects Releases Wiki Activity

change kubernetes examples to use Deployment (#3909)

Browse Source
This commit is contained in:
Rong Ou
2019-01-30 17:50:37 -08:00
committed by Robert Nishihara
parent d06d9fc5d7
commit 8f6bd6cece
5 changed files with 54 additions and 44 deletions
Download Patch File Download Diff File Expand all files Collapse all files
doc/source/deploy-on-kubernetes.rst
+27 -21
View File
@@ -35,17 +35,17 @@ minutes for the pods to enter the "Running" state).
.. code-block:: shell
$ kubectl get pods
NAME READY STATUS RESTARTS AGE
ray-head-controller-2kkfq 1/1 Running 0 47s
ray-worker-controller-d6jml 1/1 Running 0 45s
ray-worker-controller-m7jxs 1/1 Running 0 45s
ray-worker-controller-rg2sl 1/1 Running 0 45s
NAME READY STATUS RESTARTS AGE
ray-head-5455bb66c9-6bxvz 1/1 Running 0 10s
ray-worker-5c49b7cc57-c6xs8 1/1 Running 0 5s
ray-worker-5c49b7cc57-d9m86 1/1 Running 0 5s
ray-worker-5c49b7cc57-kzk4s 1/1 Running 0 5s
To run tasks interactively on the cluster, connect to one of the pods, e.g.,
.. code-block:: shell
kubectl exec -it ray-head-controller-2kkfq -- bash
kubectl exec -it ray-head-5455bb66c9-6bxvz -- bash
Start an IPython interpreter, e.g., ``ipython``
@@ -56,7 +56,9 @@ Start an IPython interpreter, e.g., ``ipython``
import time
import ray
ray.init(redis_address="{}:6379".format(socket.gethostbyname("ray-head")))
# Note that if you run this script on a non-head node, then you must replace
# "localhost" with socket.gethostbyname("ray-head").
ray.init(redis_address="localhost:6379")
@ray.remote
def f(x):
@@ -86,24 +88,28 @@ running ``kubectl get all``. You'll see output like the following.
.. code-block:: shell
$ kubectl get all
NAME READY STATUS RESTARTS AGE
pod/ray-head-controller-q6lck 1/1 Running 0 1m
pod/ray-worker-controller-kchfh 1/1 Running 0 1m
pod/ray-worker-controller-nmq5c 1/1 Running 0 1m
pod/ray-worker-controller-tfl2q 1/1 Running 0 1m
NAME READY STATUS RESTARTS AGE
pod/ray-head-5486648dc9-c6hz2 1/1 Running 0 11s
pod/ray-worker-5c49b7cc57-2jz4l 1/1 Running 0 11s
pod/ray-worker-5c49b7cc57-8nwjk 1/1 Running 0 11s
pod/ray-worker-5c49b7cc57-xlksn 1/1 Running 0 11s
NAME DESIRED CURRENT READY AGE
replicationcontroller/ray-head-controller 1 1 1 1m
replicationcontroller/ray-worker-controller 3 3 3 1m
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
service/ray-head ClusterIP 10.110.54.241 <none> 6379/TCP,6380/TCP,6381/TCP,12345/TCP,12346/TCP 11s
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
service/ray-head ClusterIP 10.64.5.153 <none> 6379/TCP,6380/TCP,6381/TCP,12345/TCP,12346/TCP 1m
NAME READY UP-TO-DATE AVAILABLE AGE
deployment.apps/ray-head 1/1 1 1 11s
deployment.apps/ray-worker 3/3 3 3 11s
Find the name of the ``ray-head-controller`` pod and run the equivalent of
NAME DESIRED CURRENT READY AGE
replicaset.apps/ray-head-5486648dc9 1 1 1 11s
replicaset.apps/ray-worker-5c49b7cc57 3 3 3 11s
Find the name of the ``ray-head`` pod and run the equivalent of
.. code-block:: shell
kubectl logs ray-head-controller-q6lck
kubectl logs ray-head-5486648dc9-c6hz2
Cleaning Up
-----------
@@ -113,8 +119,8 @@ To remove the services you have created, run the following.
.. code-block:: shell
kubectl delete service/ray-head \
replicationcontroller/ray-head-controller \
replicationcontroller/ray-worker-controller
deployment.apps/ray-head \
deployment.apps/ray-worker
Customization
kubernetes/example.py
+3 -1
View File
@@ -9,7 +9,9 @@ import time
import ray
if __name__ == "__main__":
ray.init(redis_address="{}:6379".format(socket.gethostbyname("ray-head")))
# Note that if you run this script on a non-head node, then you must
# replace "localhost" with socket.gethostbyname("ray-head").
ray.init(redis_address="localhost:6379")
# Wait for all 4 nodes to join the cluster.
while True:
kubernetes/head.yaml
+6 -6
View File
@@ -3,7 +3,6 @@ kind: Service
metadata:
name: ray-head
spec:
ports:
ports:
- name: redis-primary
port: 6379
@@ -23,14 +22,15 @@ spec:
selector:
component: ray-head
---
apiVersion: v1
kind: ReplicationController
apiVersion: apps/v1
kind: Deployment
metadata:
name: ray-head-controller
name: ray-head
spec:
replicas: 1
selector:
component: ray-head
matchLabels:
component: ray-head
template:
metadata:
labels:
@@ -54,4 +54,4 @@ spec:
fieldPath: status.podIP
resources:
requests:
cpu: 10
cpu: 2
kubernetes/submit.yaml
+12 -11
View File
@@ -3,7 +3,6 @@ kind: Service
metadata:
name: ray-head
spec:
ports:
ports:
- name: redis-primary
port: 6379
@@ -23,14 +22,15 @@ spec:
selector:
component: ray-head
---
apiVersion: v1
kind: ReplicationController
apiVersion: apps/v1
kind: Deployment
metadata:
name: ray-head-controller
name: ray-head
spec:
replicas: 1
selector:
component: ray-head
matchLabels:
component: ray-head
template:
metadata:
labels:
@@ -57,16 +57,17 @@ spec:
fieldPath: status.podIP
resources:
requests:
cpu: 10
cpu: 2
---
apiVersion: v1
kind: ReplicationController
apiVersion: apps/v1
kind: Deployment
metadata:
name: ray-worker-controller
name: ray-worker
spec:
replicas: 3
selector:
component: ray-worker
matchLabels:
component: ray-worker
template:
metadata:
labels:
@@ -87,4 +88,4 @@ spec:
fieldPath: status.podIP
resources:
requests:
cpu: 10
cpu: 2
kubernetes/worker.yaml
+6 -5
View File
@@ -1,11 +1,12 @@
apiVersion: v1
kind: ReplicationController
apiVersion: apps/v1
kind: Deployment
metadata:
name: ray-worker-controller
name: ray-worker
spec:
replicas: 3
selector:
component: ray-worker
matchLabels:
component: ray-worker
template:
metadata:
labels:
@@ -26,4 +27,4 @@ spec:
fieldPath: status.podIP
resources:
requests:
cpu: 10
cpu: 2