Skip to content

Commit 0478e5f

Browse files
committed
site doesnt support markdown syntax for ordered lists, making explicit
1 parent 9a2775d commit 0478e5f

File tree

1 file changed

+8
-8
lines changed

1 file changed

+8
-8
lines changed

site-src/guides/index.md

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -20,21 +20,21 @@ This quickstart guide is intended for engineers familiar with k8s and model serv
2020
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/pkg/manifests/vllm/deployment.yaml
2121
```
2222

23-
1. **Install the Inference Extension CRDs:**
23+
2. **Install the Inference Extension CRDs:**
2424

2525
```sh
2626
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/releases/download/v0.1.0/manifests.yaml
2727
```
2828

29-
1. **Deploy InferenceModel**
29+
3. **Deploy InferenceModel**
3030

3131
Deploy the sample InferenceModel which is configured to load balance traffic between the `tweet-summary-0` and `tweet-summary-1`
3232
[LoRA adapters](https://docs.vllm.ai/en/latest/features/lora.html) of the sample model server.
3333
```bash
3434
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/pkg/manifests/inferencemodel.yaml
3535
```
3636

37-
1. **Update Envoy Gateway Config to enable Patch Policy**
37+
4. **Update Envoy Gateway Config to enable Patch Policy**
3838

3939
Our custom LLM Gateway ext-proc is patched into the existing envoy gateway via `EnvoyPatchPolicy`. To enable this feature, we must extend the Envoy Gateway config map. To do this, simply run:
4040
```bash
@@ -43,7 +43,7 @@ This quickstart guide is intended for engineers familiar with k8s and model serv
4343
```
4444
Additionally, if you would like to enable the admin interface, you can uncomment the admin lines and run this again.
4545

46-
1. **Deploy Gateway**
46+
5. **Deploy Gateway**
4747

4848
```bash
4949
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/pkg/manifests/gateway/gateway.yaml
@@ -57,29 +57,29 @@ This quickstart guide is intended for engineers familiar with k8s and model serv
5757
inference-gateway inference-gateway <MY_ADDRESS> True 22s
5858
```
5959

60-
1. **Deploy the Inference Extension and InferencePool**
60+
6. **Deploy the Inference Extension and InferencePool**
6161

6262
```bash
6363
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/pkg/manifests/ext_proc.yaml
6464
```
6565

66-
1. **Deploy Envoy Gateway Custom Policies**
66+
7. **Deploy Envoy Gateway Custom Policies**
6767

6868
```bash
6969
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/pkg/manifests/gateway/extension_policy.yaml
7070
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/pkg/manifests/gateway/patch_policy.yaml
7171
```
7272
> **_NOTE:_** This is also per InferencePool, and will need to be configured to support the new pool should you wish to experiment further.
7373
74-
1. **OPTIONALLY**: Apply Traffic Policy
74+
8. **OPTIONALLY**: Apply Traffic Policy
7575

7676
For high-traffic benchmarking you can apply this manifest to avoid any defaults that can cause timeouts/errors.
7777

7878
```bash
7979
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/pkg/manifests/gateway/traffic_policy.yaml
8080
```
8181

82-
1. **Try it out**
82+
9. **Try it out**
8383

8484
Wait until the gateway is ready.
8585

0 commit comments

Comments
 (0)