Skip to content

Commit e01ec51

Browse files
coolkpahg-g
andauthored
Update tools/dynamic-lora-sidecar/README.md
Co-authored-by: Abdullah Gharaibeh <[email protected]>
1 parent f82d8b2 commit e01ec51

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tools/dynamic-lora-sidecar/README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Dynamic LORA Adapter Sidecar for vLLM
22

3-
This directory contains a configmap containing lora adapters configurations and script for a sidecar container to dynamically manage LORA adapters for a vLLM server running in the same Kubernetes pod by reconciling it with a configmap containing lora adapters.
3+
This is a sidecar-based tool to help rolling out new LoRA adapters to a set of running vLLM model servers. The user deploys the sidecar with a vLLM server, and using a ConfigMap, the user can express their intent as to which LoRA adapters they want to have the running vLLM servers to be configure with. The sidecar watches the ConfigMap and sends load/unload requests to the vLLM container to actuate on the user intent.
44

55
## Overview
66

0 commit comments

Comments
 (0)