모니터링 대시보드

모니터링 대시보드 (Monitoring Dashboards)

vLLM 배포를 모니터링하기 위한 Grafana·Perses 대시보드 구성 파일 모음입니다. 성능 통계(지연 시간·처리량)와 쿼리 통계(요청량·KPI) 두 가지 대시보드를 네이티브 포맷(JSON/YAML)으로 제공해 어떤 배포 방식에도 가져다 쓸 수 있습니다.

출처: 문서

본문

Grafana 대시보드는 JSON이라 Grafana UI 또는 API로 바로 가져올 수 있고, Perses 대시보드는 YAML 사양이라 CLI로 적용합니다. 두 플랫폼 모두 Dashboard-as-Code나 Kubernetes Operator 래핑을 지원합니다.

README.md

# Monitoring Dashboards

This directory contains monitoring dashboard configurations for vLLM, providing
comprehensive observability for your vLLM deployments.

## Dashboard Platforms

We provide dashboards for two popular observability platforms:

- **[Grafana](https://grafana.com)**
- **[Perses](https://perses.dev)**

## Dashboard Format Approach

All dashboards are provided in **native formats** that work across different
deployment methods:

### Grafana (JSON)

- ✅ Works with any Grafana instance (cloud, self-hosted, Docker)
- ✅ Direct import via Grafana UI or API
- ✅ Can be wrapped in Kubernetes operators when needed
- ✅ No vendor lock-in or deployment dependencies

### Perses (YAML)

- ✅ Works with standalone Perses instances
- ✅ Compatible with Perses API and CLI
- ✅ Supports Dashboard-as-Code workflows
- ✅ Can be wrapped in Kubernetes operators when needed

## Dashboard Contents

Both platforms provide equivalent monitoring capabilities:

| Dashboard | Description |
| --------- | ----------- |
| **Performance Statistics** | Tracks latency, throughput, and performance metrics |
| **Query Statistics** | Monitors request volume, query performance, and KPIs |

## Quick Start

First, navigate to this example's directory:

```bash
cd examples/observability/dashboards

Grafana

Import the JSON directly into the Grafana UI, or use the API:

curl -X POST http://grafana/api/dashboards/db \
  -H "Content-Type: application/json" \
  -d @grafana/performance_statistics.json

Perses

Import via the Perses CLI:

percli apply -f perses/performance_statistics.yaml

Requirements

Prometheus metrics from your vLLM deployment
Data source configured in your monitoring platform
vLLM metrics enabled and accessible

Platform-Specific Documentation

For detailed deployment instructions and platform-specific options, see:

Grafana Documentation - JSON dashboards, operator usage, manual import
Perses Documentation - YAML specs, CLI usage, operator wrapping

Contributing

When adding new dashboards, please:

Provide native formats (JSON for Grafana, YAML specs for Perses)
Update platform-specific README files
Ensure dashboards work across deployment methods
Test with the latest platform versions


## 더 알아보기 (Learn more)

- [Metrics](https://docs.vllm.ai/en/latest/examples/observability/metrics/) — vLLM 지표 예제
- [Prometheus & Grafana](https://docs.vllm.ai/en/latest/examples/observability/prometheus_grafana/) — Prometheus에서 Grafana로
- [Metrics Reference](https://docs.vllm.ai/en/latest/usage/metrics/) — 사용 가능한 지표