Infrastructure/Gluttony-Cluster
2
1
Fork 0
Code Issues 13 Pull Requests Packages Wiki Activity

Add base model to load
All checks were successful
continuous-integration/drone/push Build is passing
Details

Browse Source
This commit is contained in:
Tyler Perkins 2024-04-05 23:56:41 -04:00
parent 3ba49b3624
commit 9e8022068f
Signed by: tyler
GPG Key ID: 03B27509E17EFDC8
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
localai/localai-deployment.yaml
View File

@ -17,6 +17,7 @@ spec:
containers: containers:
- name: localai - name: localai
image: quay.io/go-skynet/local-ai:v2.11.0-cublas-cuda12-ffmpeg image: quay.io/go-skynet/local-ai:v2.11.0-cublas-cuda12-ffmpeg
args: ["dolphin-2.7-mixtral-8x7b-GGUF"]
ports: ports:
- containerPort: 8080 - containerPort: 8080
#env: #env: