wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-18 12:30:29 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,021 Commits 1 Branch 0 Tags
5757d90e26464d4582e36b55a2a0f34aec408e7f
Commit Graph
4 Commits
Author SHA1 Message Date
Cade Daniel 93deb0b38f [Speculative decoding 4/9] Lookahead scheduling for speculative decoding (#3250) 2024-04-01 22:55:24 +00:00
Cade Daniel 14ccd94c89 [Core][Bugfix]Refactor block manager for better testability (#3492) 2024-03-27 23:59:28 -07:00
Cade Daniel a33ce60c66 [Testing] Fix core tests (#3224) 2024-03-06 01:04:23 -08:00
SangBin Cho 24aecf421a [Tests] Add block manager and scheduler tests (#3108) 2024-03-05 18:23:34 -08:00