@@ -119,9 +119,9 @@ This quickstart guide is intended for engineers familiar with k8s and model serv
119
119
120
120
5. Given that the default connection timeout may be insufficient for most inference workloads, it is recommended to configure a timeout appropriate for your intended use case.
121
121
122
- ```bash
123
- kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/gke/gcp-backend-policy.yaml
124
- ```
122
+ ```bash
123
+ kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/gke/gcp-backend-policy.yaml
124
+ ```
125
125
126
126
=== "Istio"
127
127
@@ -269,10 +269,10 @@ This quickstart guide is intended for engineers familiar with k8s and model serv
269
269
270
270
### Cleanup
271
271
272
- The following cleanup assumes you would like to clean ALL resources that were created in this quickstart guide.
272
+ The following instructions assume you would like to cleanup ALL resources that were created in this quickstart guide.
273
273
Please be careful not to delete resources you'd like to keep.
274
274
275
- 1 . Uninstall the Inference Pool
275
+ 1 . Uninstall the InferencePool, InferenceModel, and model server resources
276
276
277
277
``` bash
278
278
kubectl delete -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/inferencepool-resources.yaml --ignore-not-found
@@ -282,7 +282,7 @@ This quickstart guide is intended for engineers familiar with k8s and model serv
282
282
kubectl delete secret hf-token --ignore-not-found
283
283
```
284
284
285
- 1. Uninstall the Gateway
285
+ 1. Uninstall the Gateway API resources
286
286
287
287
` ` ` bash
288
288
kubectl delete -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/gke/gateway.yaml --ignore-not-found
@@ -296,8 +296,40 @@ This quickstart guide is intended for engineers familiar with k8s and model serv
296
296
kubectl delete -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/kgateway/httproute.yaml --ignore-not-found
297
297
` ` `
298
298
299
- 1. Uninstall the CRDs
299
+ 1. Uninstall the Gateway API Inference Extension CRDs
300
300
301
301
` ` ` bash
302
302
kubectl delete -k https://github.com/kubernetes-sigs/gateway-api-inference-extension/config/crd --ignore-not-found
303
303
` ` `
304
+
305
+ 1. Choose one of the following options to cleanup the Inference Gateway.
306
+
307
+ === " GKE"
308
+
309
+ ** TODO**
310
+
311
+ === " Istio"
312
+
313
+ ** TODO**
314
+
315
+ === " Kgateway"
316
+
317
+ The following instructions assume you would like to cleanup ALL Kgateway resources that were created in this quickstart guide.
318
+
319
+ 1. Uninstall Kgateway
320
+
321
+ ` ` ` bash
322
+ helm uninstall kgateway -n kgateway-system
323
+ ` ` `
324
+
325
+ 1. Uninstall the Kgateway CRDs.
326
+
327
+ ` ` ` bash
328
+ helm uninstall kgateway-crds -n kgateway-system
329
+ ` ` `
330
+
331
+ 1. Remove the Kgateway namespace.
332
+
333
+ ` ` ` bash
334
+ kubectl delete ns kgateway-system
335
+ ` ` `
0 commit comments