Skip to content

Docs: Adds Kgateway Cleanup to Quickstart #701

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Apr 17, 2025
Merged

Docs: Adds Kgateway Cleanup to Quickstart #701

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
46 changes: 39 additions & 7 deletions site-src/guides/index.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -119,9 +119,9 @@ This quickstart guide is intended for engineers familiar with k8s and model serv

5. Given that the default connection timeout may be insufficient for most inference workloads, it is recommended to configure a timeout appropriate for your intended use case.

```bash
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/gke/gcp-backend-policy.yaml
```
```bash
kubectl apply -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/gke/gcp-backend-policy.yaml
```

=== "Istio"

Expand Down Expand Up @@ -269,10 +269,10 @@ This quickstart guide is intended for engineers familiar with k8s and model serv

### Cleanup

The following cleanup assumes you would like to clean ALL resources that were created in this quickstart guide.
The following instructions assume you would like to cleanup ALL resources that were created in this quickstart guide.
Please be careful not to delete resources you'd like to keep.

1. Uninstall the Inference Pool
1. Uninstall the InferencePool, InferenceModel, and model server resources

```bash
kubectl delete -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/inferencepool-resources.yaml --ignore-not-found
Expand All @@ -282,7 +282,7 @@ This quickstart guide is intended for engineers familiar with k8s and model serv
kubectl delete secret hf-token --ignore-not-found
```

1. Uninstall the Gateway
1. Uninstall the Gateway API resources

```bash
kubectl delete -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/gke/gateway.yaml --ignore-not-found
Expand All @@ -296,8 +296,40 @@ This quickstart guide is intended for engineers familiar with k8s and model serv
kubectl delete -f https://github.com/kubernetes-sigs/gateway-api-inference-extension/raw/main/config/manifests/gateway/kgateway/httproute.yaml --ignore-not-found
```

1. Uninstall the CRDs
1. Uninstall the Gateway API Inference Extension CRDs

```bash
kubectl delete -k https://github.com/kubernetes-sigs/gateway-api-inference-extension/config/crd --ignore-not-found
```

1. Choose one of the following options to cleanup the Inference Gateway.

=== "GKE"

**TODO**

=== "Istio"

**TODO**

=== "Kgateway"

The following instructions assume you would like to cleanup ALL Kgateway resources that were created in this quickstart guide.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: remove this line which repeats the exact same words as the cleanup starting phrase.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm going to leave the line as-is for now. It can be removed in the future if we feel it's an issue.


1. Uninstall Kgateway

```bash
helm uninstall kgateway -n kgateway-system
```

1. Uninstall the Kgateway CRDs.

```bash
helm uninstall kgateway-crds -n kgateway-system
```

1. Remove the Kgateway namespace.

```bash
kubectl delete ns kgateway-system
```