Skip to content

feat(tools): add lightweight vLLM monitoring stack with VictoriaMetrics#919

Open
Potterluo wants to merge 2 commits into
ModelEngine-Group:developfrom
Potterluo:feature_test_monitor
Open

feat(tools): add lightweight vLLM monitoring stack with VictoriaMetrics#919
Potterluo wants to merge 2 commits into
ModelEngine-Group:developfrom
Potterluo:feature_test_monitor

Conversation

@Potterluo
Copy link
Copy Markdown
Contributor

feat(tools): add lightweight vLLM monitoring stack with VictoriaMetrics

  • Single-container deployment (no Grafana required)
  • Built-in VMUI for metrics visualization and CSV export
  • Support offline/air-gapped deployment via docker save/load
  • <100MB memory footprint, suitable for customer on-site testing
  • Pre-configured vLLM scrape templates and common PromQL queries
image image image

- Single-container deployment (no Grafana required)
- Support offline/air-gapped deployment via docker save/load
@Potterluo Potterluo force-pushed the feature_test_monitor branch from 53ffb91 to afabc26 Compare April 17, 2026 08:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant