Skip to content

Commit e9f2de7

Browse files
committed
[Metrics] Add grafana dashboard for inferecen extension and vLLM metrics
1 parent 906de56 commit e9f2de7

File tree

4 files changed

+1383
-0
lines changed

4 files changed

+1383
-0
lines changed

examples/dashboards/README.md

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
# Documentation
2+
3+
This documentation is the instruction for setting grafana dashboards to see metrics emitted from the inference gateway and inference servers.
4+
5+
## Requirements
6+
7+
Please follow [metrics](https://github.com/kubernetes-sigs/gateway-api-inference-extension/tree/main/pkg/ext-proc/metrics) page to configure the proxy to enable all metrics.
8+
9+
## Load grafana dashboard into Grafana
10+
11+
Please follow [grafana instruction](https://grafana.com/docs/grafana/latest/dashboards/build-dashboards/import-dashboards/) to load the dashboard json.
12+
13+
## Configure Google Managed Prometheus as source for metrics
14+
15+
If you run the inferece gateway with [Google Managed Prometheus], please follow the [instruction](https://cloud.google.com/stackdriver/docs/managed-prometheus/query) to configure Google Managed Prometheus as data source for the grafana dashboard.

0 commit comments

Comments
 (0)