|
|
f17a1a8f96
|
[Misc] Make Serving Benchmark More User-friendly (#5044)
|
2024-05-25 17:28:16 +00:00 |
|
|
|
fe3b5bbc23
|
[Bugfix] fix output parsing error for trtllm backend (#4137)
Co-authored-by: Roger Wang <ywang@roblox.com>
|
2024-04-17 11:07:23 +00:00 |
|
|
|
c2b4a1bce9
|
[Doc] Add typing hints / mypy types cleanup (#3816)
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
|
2024-04-11 17:17:21 -07:00 |
|
|
|
ccb58b23e6
|
[Misc] Fix Benchmark TTFT Calculation for Chat Completions (#3768)
|
2024-04-01 15:24:30 -07:00 |
|
|
|
45b6ef6513
|
feat(benchmarks): Add Prefix Caching Benchmark to Serving Benchmark (#3277)
|
2024-03-27 13:39:26 -07:00 |
|
|
|
8e67598aa6
|
[Misc] fix line length for entire codebase (#3444)
|
2024-03-16 00:36:29 -07:00 |
|
|
|
14e3f9a1b2
|
Replace lstrip() with removeprefix() to fix Ruff linter warning (#2958)
|
2024-03-15 21:01:30 -07:00 |
|
|
|
9a4548bae7
|
Fix the openai benchmarking requests to work with latest OpenAI apis (#2992)
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
|
2024-03-04 15:51:56 -08:00 |
|
|
|
a4211a4dc3
|
Serving Benchmark Refactoring (#2433)
|
2024-02-12 22:53:00 -08:00 |
|
