wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-18 12:50:17 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,863 Commits 1 Branch 0 Tags
fc17110bbef4e78703abffac51133a2fb71e9f79
Commit Graph
2 Commits
Author SHA1 Message Date
Nick HillGitHubAbhinav Goyal
 		2110557dab [BugFix] Fix cuda graph for MLPSpeculator (#5875) 
Co-authored-by: Abhinav Goyal <abhinav.goyal@flipkart.com>
 2024-06-27 04:12:10 +00:00
Joshua RosenkranzGitHubThomas ParnellNick HillDavis Wertheimer
 		b12518d3cf [Model] MLPSpeculator speculative decoding support (#4947) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Davis Wertheimer <Davis.Wertheimer@ibm.com>
 2024-06-20 20:23:12 -04:00