Skip to content

Commit 5cbaeef

Browse files
committed
Address comments in example deployment
Signed-off-by: Kunjan Patel <[email protected]>
1 parent 56cffc2 commit 5cbaeef

File tree

1 file changed

+17
-1
lines changed

1 file changed

+17
-1
lines changed

examples/dynamic-lora-sidecar/deployment.yaml

+17-1
Original file line numberDiff line numberDiff line change
@@ -94,4 +94,20 @@ spec:
9494
ports:
9595
- protocol: TCP
9696
port: 8000
97-
targetPort: 8000
97+
targetPort: 8000
98+
99+
---
100+
101+
apiVersion: v1
102+
kind: ConfigMap
103+
metadata:
104+
name: dynamic-lora-config
105+
data:
106+
configmap.yaml: |
107+
vLLMLoRAConfig:
108+
host: localhost
109+
models:
110+
- base-model: meta-llama/Llama-2-7b-hf
111+
id: sql-lora-v1
112+
source: yard1/llama-2-7b-sql-lora-test
113+
name: sql-lora

0 commit comments

Comments
 (0)