youngkingdom/vllm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

[V1][Metrics] Support vllm:cache_config_info (#13299)

Browse Source
This commit is contained in:
Mark McLoughlin
2025-02-22 08:20:00 +00:00
committed by GitHub
parent fca20841c2
commit 1cd981da4f
5 changed files with 32 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
tests/entrypoints/openai/test_metrics.py
View File

@ -230,6 +230,7 @@ EXPECTED_METRICS_V1 = [
"vllm:prompt_tokens_total",
"vllm:generation_tokens_total",
"vllm:iteration_tokens_total",
"vllm:cache_config_info",
"vllm:request_success_total",
"vllm:request_prompt_tokens_sum",
"vllm:request_prompt_tokens_bucket",