Skip to content

Commit 3c6d5a1

Browse files
committed
Update README on envoy 8081 port
1 parent 2097027 commit 3c6d5a1

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/poc/README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@ This project sets up an Envoy gateway with a custom external processing which i
2222
kubectl apply -f ./manifests/samples/vllm-lora-service.yaml
2323
```
2424
2. **Install GatewayClass with Ext Proc**
25-
A custom GatewayClass `llm-gateway` which is configured with the llm routing ext proc will be installed into the `llm-gateway` namespace. When you create Gateways, make sure the `llm-gateway` GatewayClass is used.
25+
A custom GatewayClass `llm-gateway` which is configured with the llm routing ext proc will be installed into the `llm-gateway` namespace. It's configured to listen on port 8081 for traffic through ext-proc (in addition to the default 8080), see the `EnvoyProxy` configuration in `installation.yaml`. When you create Gateways, make sure the `llm-gateway` GatewayClass is used.
2626

2727
NOTE: Ensure the `llm-route-ext-proc` deployment is updated with the pod names and internal IP addresses of the vLLM replicas. This step is crucial for the correct routing of requests based on headers. This won't be needed once we make ext proc dynamically read the pods.
2828

0 commit comments

Comments
 (0)