|
|
70d268a399
|
[Bugfix] Fix ITL recording in serving benchmark (#7372)
|
2024-08-09 10:00:00 -07:00 |
|
|
|
c4774eb841
|
[Bugfix] Fix snapshot download in serving benchmark (#6318)
|
2024-07-11 07:04:05 +00:00 |
|
|
|
e373853e12
|
[Frontend] Relax api url assertion for openai benchmarking (#6046)
|
2024-07-01 23:39:10 +00:00 |
|
|
|
bb60326836
|
[Misc] update benchmark backend for scalellm (#6018)
|
2024-07-01 10:20:33 -07:00 |
|
|
|
c4bca740e8
|
[Bugfix] fix missing last itl in openai completions benchmark (#5926)
|
2024-06-29 10:34:42 +08:00 |
|
|
|
1f12122b17
|
[Misc] use AutoTokenizer for benchmark serving when vLLM not installed (#5588)
|
2024-06-17 09:40:35 -07:00 |
|
|
|
88407532e7
|
[Bugfix]if the content is started with ":"(response of ping), client should i… (#5303)
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
|
2024-06-12 20:16:41 -07:00 |
|
|
|
f17a1a8f96
|
[Misc] Make Serving Benchmark More User-friendly (#5044)
|
2024-05-25 17:28:16 +00:00 |
|
|
|
fe3b5bbc23
|
[Bugfix] fix output parsing error for trtllm backend (#4137)
Co-authored-by: Roger Wang <ywang@roblox.com>
|
2024-04-17 11:07:23 +00:00 |
|
|
|
c2b4a1bce9
|
[Doc] Add typing hints / mypy types cleanup (#3816)
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
|
2024-04-11 17:17:21 -07:00 |
|
|
|
ccb58b23e6
|
[Misc] Fix Benchmark TTFT Calculation for Chat Completions (#3768)
|
2024-04-01 15:24:30 -07:00 |
|
|
|
45b6ef6513
|
feat(benchmarks): Add Prefix Caching Benchmark to Serving Benchmark (#3277)
|
2024-03-27 13:39:26 -07:00 |
|
|
|
8e67598aa6
|
[Misc] fix line length for entire codebase (#3444)
|
2024-03-16 00:36:29 -07:00 |
|
|
|
14e3f9a1b2
|
Replace lstrip() with removeprefix() to fix Ruff linter warning (#2958)
|
2024-03-15 21:01:30 -07:00 |
|
|
|
9a4548bae7
|
Fix the openai benchmarking requests to work with latest OpenAI apis (#2992)
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
|
2024-03-04 15:51:56 -08:00 |
|
|
|
a4211a4dc3
|
Serving Benchmark Refactoring (#2433)
|
2024-02-12 22:53:00 -08:00 |
|
