wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-22 13:00:10 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,252 Commits 1 Branch 0 Tags
0fa14907da70f3cbf9eb97d68d760b181a9a25a7
Commit Graph
3 Commits
Author SHA1 Message Date
Michael GoinandGitHub 978aed5300 [Kernel][Attention] Separate Attention.kv_scale into k_scale and v_scale (#6081) 2024-07-16 15:31:32 -07:00
Cyrus LeungandGitHub 0e9164b40a [mypy] Enable type checking for test directory (#5017) 2024-06-15 04:45:31 +00:00
Eric Xihui LinGitHubbeagleskibapatraBarun PatraMichael Goin
 		8e192ff967 [Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) 
Co-authored-by: beagleski <yunanzhang@microsoft.com>
Co-authored-by: bapatra <bapatra@microsoft.com>
Co-authored-by: Barun Patra <codedecde@users.noreply.github.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
 2024-05-24 22:00:52 -07:00