Skip to content

Commit 28779e7

Browse files
coolkpahg-g
andauthored
Update tools/dynamic-lora-sidecar/README.md
Co-authored-by: Abdullah Gharaibeh <[email protected]>
1 parent e01ec51 commit 28779e7

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tools/dynamic-lora-sidecar/README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -65,7 +65,7 @@ The sidecar uses the vLLM server's API to load or unload adapters based on the c
6565

6666

6767
## Screenshots & Testing
68-
I tested the sidecar in my cluster with deployment and configmap specified in this repo. Here are the screen grabs of the logs from the sidecar and vllm server. I used the specified configmap, verified that the adapters were loaded by querying `v1/models` and looking at vllm logs. I changed the configmap and validated the same on vllm server. Note: There is slight lag between updates.
68+
The sidecar was tested with the Deployment and ConfigMap specified in this repo. Here are screen grabs of the logs from the sidecar and vllm server. One can verify that the adapters were loaded by querying `v1/models` and looking at vllm logs.
6969
![lora-adapter-syncer](screenshots/lora-syncer-sidecar.png)
7070
![config map change](screenshots/configmap-change.png)
7171
![vllm-logs](screenshots/vllm-logs.png)

0 commit comments

Comments
 (0)