Infrastructure/Gluttony-Cluster
2
1
Fork 0
Code Issues 13 Pull Requests Packages Wiki Activity

Add nvidia runtime
All checks were successful
continuous-integration/drone/push Build is passing
Details

Browse Source
This commit is contained in:
Tyler Perkins 2024-03-30 22:39:54 -04:00
parent ab12752c83
commit 28a5a521ee
Signed by: tyler
GPG Key ID: 03B27509E17EFDC8
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
vllm/vllm-deployment.yaml
View File

@ -13,6 +13,7 @@ spec:
labels: labels:
app: vllm-inference-server app: vllm-inference-server
spec: spec:
runtimeClassName: nvidia
containers: containers:
- name: vllm-inference-server - name: vllm-inference-server
image: vllm/vllm-openai:v0.3.3 image: vllm/vllm-openai:v0.3.3