wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-16 11:23:03 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,805 Commits 1 Branch 0 Tags
7cd2ebb0251fd1fd0eec5c93dac674603a22eddd
Commit Graph
4 Commits
Author SHA1 Message Date
sroy745andGitHub 80ca1e6a3a [Speculative Decoding 2/2 ] Integrate typical acceptance sampler into Spec Decode Worker (#5348) 2024-07-01 00:33:05 -07:00
Nick HillandGitHub faf71bcd4b [Speculative Decoding] Add ProposerWorkerBase abstract class (#5252) 2024-06-05 14:53:05 -07:00
Lily LiuandGitHub d5a1697772 [Dynamic Spec Decoding] Minor fix for disabling speculative decoding (#5000) 2024-05-25 10:00:14 -07:00
Cody YuGitHubCade Daniel
 		f942efb5a3 [Dynamic Spec Decoding] Auto-disable by the running queue size (#4592) 
Co-authored-by: Cade Daniel <edacih@gmail.com>
 2024-05-08 21:44:00 +00:00