wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-13 09:16:59 +08:00
Code Issues Packages Projects Releases Wiki Activity
366 Commits 1 Branch 0 Tags
bbbf86565f2fb2bab0cf6675f9ebefcd449390bd
Commit Graph

3 Commits

Author SHA1 Message Date
Antoni Baum c9927c1a6a Use queue for finished requests (#957) 2023-09-05 19:27:23 -07:00
Zhuohan Li 002800f081 Align vLLM's beam search implementation with HF generate (#857) 2023-09-04 17:29:42 -07:00
Woosuk Kwon 32b6816e55 Add tests for models (#922) 2023-09-01 11:19:43 +09:00