Kubernetes can support GPUs to speed parallel processing, and auto-scaling in environments that support it. This feature can be used for Machine Learning and Data Science applications. Kublr can automaticaly detects GPUs on AWS and Azure instances and configure the environment to use GPUs with Kubernetes.
This document explains:
On AWS Kublr supports GPUs on Ubuntu 16.04 and RedHat 7.5 for the following GPU instances:
On Azure Kublr supports GPUs on Ubuntu 16.04 for the following GPU instances:
Kublr supports GPU for the following NVIDIA devices:
On AWS:
On Azure:
Click ‘Create Cluster’ and wait until the cluster is created.
Be sure that NVIDIA GPU controller exists:
# lspci -m -nn
....
00:1e.0 "3D controller [0302]""NVIDIA Corporation [10de]""GK210GL [Tesla K80] [102d]"-ra1 "NVIDIA Corporation [10de]""Device [106c]"
....
#
#
# nvidia-smi
Mon Jun 18 10:15:50 2018
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 396.26 Driver Version: 396.26 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 Tesla K80 Off | 00000000:00:1E.0 Off | 0 |
| N/A50C P8 27W / 149W | 0MiB / 11441MiB | 0% Default |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
| No running processes found |
+-----------------------------------------------------------------------------+
#
# nvidia-smi -L
GPU 0: Tesla K80 (UUID: GPU-860ba7bf-e331-54b4-6e2c-322fb389597b)
Be sure that docker configured correctly:
# docker run --rm nvidia/cuda nvidia-smi
Mon Jun 18 10:15:50 2018
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 396.26 Driver Version: 396.26 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 Tesla K80 Off | 00000000:00:1E.0 Off | 0 |
| N/A50C P8 27W / 149W | 0MiB / 11441MiB | 0% Default |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
| No running processes found |
+-----------------------------------------------------------------------------+
Prerequsites:
Copy KubeConfig file from cluster’s Overview page and move it to dir .kube
$ cp ~/Downloads/config.yaml ~/.kube/config
Check that kubectl is working and using right config file:
$ kubectl config view
$ kubectl cluster-info
Change directory to ../demo7-gpu and install chart
$ helm install dockerGPUHelm --name demo7
NAME: demo7
LAST DEPLOYED: Thu Aug 9 13:09:01 2018
NAMESPACE: default
STATUS: DEPLOYED
RESOURCES:
==> v1/Pod(related)
NAME READY STATUS RESTARTS AGE
demo7-demo-gpu-5cc6795c4-sgnz9 0/1 ContainerCreating 0 1s
==> v1/Service
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
demo7-demo-gpu ClusterIP 100.70.66.123 <none> 80/TCP 1s
==> v1beta2/Deployment
NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
demo7-demo-gpu 1 1 1 0 1s
Run command for port forwarding (pod_name in the previous console output)
$ kubectl port-forward <POD_NAME> 8000:8000
Forwarding from 127.0.0.1:8000 -> 8000
Get video streem: open this link in browser http://localhost:8000/
Open file ../demo7-gpu/dockerGPUHelm/templates/deployment.yaml
Change the value of parameter VIDEO_LINK. Note: you can change value of VIDEO_OUTPUT_COMPRESSION for the desired video quality level.
Upgrade the helm chart. Note: You should wait approximately a minute until the previous Pod is terminated.
$ helm upgrade demo7 dockerGPUHelm
Release "demo7" has been upgraded. Happy Helming!
LAST DEPLOYED: Thu Aug 9 13:42:54 2018
NAMESPACE: default
STATUS: DEPLOYED
Create a new Pod’s name.
$ kubectl get pods --all-namespaces |grep demo7
Run command for port forwarding.
Open link http://localhost:8000/ to get video stream.
In the process of installing the cluster, Kublr checks for the presence of GPU devices and, if detected, does the following: