Infrastructure/Gluttony-Cluster
2
1
Fork 0
Code Issues 13 Pull Requests Packages Wiki Activity

Fix syntax
All checks were successful
continuous-integration/drone/push Build is passing
Details

Browse Source
This commit is contained in:
Tyler Perkins 2024-03-30 18:02:14 -04:00
parent aca0c984d4
commit ef16d45ff1
Signed by: tyler
GPG Key ID: 03B27509E17EFDC8
1 changed files with 2 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
openllm/openllm-deployment.yaml
View File

@ -17,11 +17,9 @@ spec:
containers: containers:
- name: openllm-container - name: openllm-container
image: ghcr.io/bentoml/openllm image: ghcr.io/bentoml/openllm
args: ["start", "${MODEL_NAME}", "--backend", "vllm"]
env:
# Set this to desired deployment model # Set this to desired deployment model
- name: MODEL_NAME args: ["start", "meta-llama/Llama-2-13b-hf", "--backend", "vllm"]
value: "meta-llama/Llama-2-13b-hf" env:
- name: TRUST_REMOVE_CODE - name: TRUST_REMOVE_CODE
value: "True" value: "True"
- name: OPENLLM_DO_NOT_TRACK - name: OPENLLM_DO_NOT_TRACK