wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-18 12:30:29 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,753 Commits 1 Branch 0 Tags
86e9c8df29a954a7a2fc46e9985fecc2a2e15ae8
Commit Graph
2 Commits
Author SHA1 Message Date
ElizaWszolaandDipika a091e2da3e [Kernel] Enable 8-bit weights in Fused Marlin MoE (#8032) 
Co-authored-by: Dipika <dipikasikka1@gmail.com>
 2024-09-16 09:47:19 -06:00
Dipika Sikka 6cd5e5b07e [Misc] Fused MoE Marlin support for GPTQ (#8217) 2024-09-09 23:02:52 -04:00