wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-18 12:30:29 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,833 Commits 1 Branch 0 Tags
2e7fe7e79f41e294eeed2f484eeb791284ec48a2
Commit Graph
3 Commits
Author SHA1 Message Date
Nick Hill 39178c7fbc [Tests] Disable retries and use context manager for openai client (#7565) 2024-08-26 21:33:17 -07:00
Pooya Davoodi 8da48e4d95 [Frontend] Publish Prometheus metrics in run_batch API (#7641) 2024-08-23 23:04:22 -07:00
Robert ShawandNick Hill e3b318216d [ Bugfix ] Fix Prometheus Metrics With zeromq Frontend (#7279) 
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
 2024-08-18 20:19:48 +00:00