EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

[Feat.] Enable grafana to show metrics (#4718)

Browse Source 
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
This commit is contained in:
Huapeng Zhou
2025-04-21 15:43:42 +08:00
committed by GitHub
parent a7591ecf69
commit 57131dd955
6 changed files with 115 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/references/production_metrics.md
View File

@@ -2,7 +2,7 @@
SGLang exposes the following metrics via Prometheus. The metrics are namespaced by `$name` (the model name).
An example of the monitoring dashboard is available in [examples/monitoring/grafana.json](../examples/monitoring/grafana.json).
An example of the monitoring dashboard is available in [examples/monitoring/grafana.json](../examples/monitoring/grafana/dashboards/json/sglang-dashboard.json).
Here is an example of the metrics:
@@ -150,7 +150,7 @@ In a new Grafana setup, ensure that you have the `Prometheus` data source enable
If not, click `Add data source` -> `Prometheus`, set Prometheus URL to `http://localhost:9090`, and click `Save & Test`.
To import the Grafana dashboard, click `+` -> `Import` -> `Upload JSON file` -> `Upload` and select [grafana.json](../examples/monitoring/grafana.json).
To import the Grafana dashboard, click `+` -> `Import` -> `Upload JSON file` -> `Upload` and select [grafana.json](../examples/monitoring/grafana/dashboards/json/sglang-dashboard.json).
### Troubleshooting