wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-13 05:02:16 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,245 Commits 1 Branch 0 Tags
826b82a260ebb1ea7edd04a3278d5fb9b103a76e
Commit Graph

1 Commits

Author SHA1 Message Date
Cade Daniel e95cd87959 [Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894) 2024-04-16 13:09:21 -07:00