wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-20 12:40:26 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,344 Commits 1 Branch 0 Tags
fc0d9dfc3afcea2e23649ef8eb8bbe0446682813
Commit Graph
3 Commits
Author SHA1 Message Date
youkaichaoandGitHub 469f85c782 [Core][Optimization] change copy-on-write from dict[int, list] to list (#4648) 2024-05-07 11:06:32 -07:00
Cade DanielandGitHub 93deb0b38f [Speculative decoding 4/9] Lookahead scheduling for speculative decoding (#3250) 2024-04-01 22:55:24 +00:00
Cade DanielandGitHub 14ccd94c89 [Core][Bugfix]Refactor block manager for better testability (#3492) 2024-03-27 23:59:28 -07:00