6 Commits

Author	SHA1	Message	Date
Roger Wang	ccb58b23e6	[Misc] Fix Benchmark TTFT Calculation for Chat Completions (#3768)	2024-04-01 15:24:30 -07:00
Roger Wang	45b6ef6513	feat(benchmarks): Add Prefix Caching Benchmark to Serving Benchmark (#3277)	2024-03-27 13:39:26 -07:00
Simon Mo	8e67598aa6	[Misc] fix line length for entire codebase (#3444)	2024-03-16 00:36:29 -07:00
Ronen Schaffer	14e3f9a1b2	Replace lstrip() with removeprefix() to fix Ruff linter warning (#2958)	2024-03-15 21:01:30 -07:00
Chen Wang	9a4548bae7	Fix the openai benchmarking requests to work with latest OpenAI apis (#2992) ... Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>	2024-03-04 15:51:56 -08:00
Roger Wang	a4211a4dc3	Serving Benchmark Refactoring (#2433)	2024-02-12 22:53:00 -08:00