Infrastructure/Gluttony-Cluster
2
1
Fork 0
Code Issues 13 Pull Requests Packages Wiki Activity

Update ollama to use gpu
All checks were successful
continuous-integration/drone/push Build is passing
Details

Browse Source
This commit is contained in:
Tyler Perkins 2024-04-12 21:05:57 -04:00
parent 25f8c5b216
commit 7f3bb2c1f3
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
ollama/ollama-deployment.yaml
View File

@ -13,11 +13,15 @@ spec:
labels: labels:
app: ollama app: ollama
spec: spec:
runtimeClassName: nvidia
containers: containers:
- name: ollama - name: ollama
image: ollama/ollama image: ollama/ollama
ports: ports:
- containerPort: 11434 - containerPort: 11434
resources:
limits:
nvidia.com/gpu: 2
volumeMounts: volumeMounts:
- name: ollama-volume - name: ollama-volume
mountPath: /root/.ollama mountPath: /root/.ollama