wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-07 11:30:39 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,471 Commits 1 Branch 0 Tags
aa375dca9fbeff03904cd7b7dcc5014bfa19b0fb
Commit Graph
6 Commits
Author SHA1 Message Date
Dipika SikkaandGitHub 7ca9934fe7 [Misc] Update w2 scale loading for GPTQMarlinMoE (#12757) 2025-02-06 01:02:14 -08:00
Michael GoinandGitHub ce00231a8b [Bugfix] Fix Weight Loading Multiple GPU Test - Large Models (#9213) 2024-10-10 14:15:40 +08:00
ElizaWszolaGitHubDipikaDipika Sikka
 		05d686432f [Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) 
Co-authored-by: Dipika <dipikasikka1@gmail.com>
Co-authored-by: Dipika Sikka <ds3822@columbia.edu>
 2024-10-04 12:34:44 -06:00
Michael GoinandGitHub 873edda6cf [Misc] Support FP8 MoE for compressed-tensors (#8588) 2024-09-25 09:43:36 -07:00
ElizaWszolaGitHubDipika
 		a091e2da3e [Kernel] Enable 8-bit weights in Fused Marlin MoE (#8032) 
Co-authored-by: Dipika <dipikasikka1@gmail.com>
 2024-09-16 09:47:19 -06:00
Dipika SikkaandGitHub 6cd5e5b07e [Misc] Fused MoE Marlin support for GPTQ (#8217) 2024-09-09 23:02:52 -04:00