wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-14 11:19:39 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,047 Commits 1 Branch 0 Tags
e4be7d70bbac47b2c309caa20e68fc43e05e0550
Commit Graph
6 Commits
Author SHA1 Message Date
Roger WangandGitHub ccb58b23e6 [Misc] Fix Benchmark TTFT Calculation for Chat Completions (#3768) 2024-04-01 15:24:30 -07:00
Roger WangandGitHub 45b6ef6513 feat(benchmarks): Add Prefix Caching Benchmark to Serving Benchmark (#3277) 2024-03-27 13:39:26 -07:00
Simon MoandGitHub 8e67598aa6 [Misc] fix line length for entire codebase (#3444) 2024-03-16 00:36:29 -07:00
Ronen SchafferandGitHub 14e3f9a1b2 Replace lstrip() with removeprefix() to fix Ruff linter warning (#2958) 2024-03-15 21:01:30 -07:00
Chen WangGitHubRoger Wang
 		9a4548bae7 Fix the openai benchmarking requests to work with latest OpenAI apis (#2992) 
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
 2024-03-04 15:51:56 -08:00
Roger WangandGitHub a4211a4dc3 Serving Benchmark Refactoring (#2433) 2024-02-12 22:53:00 -08:00