wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-08 11:29:04 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,344 Commits 1 Branch 0 Tags
fc0d9dfc3afcea2e23649ef8eb8bbe0446682813
Commit Graph
3 Commits
Author SHA1 Message Date
alexm-nmandGitHub e288df0632 [Bugfix] Fine-tune gptq_marlin configs to be more similar to marlin (#4626) 2024-05-08 17:14:31 -07:00
alexm-nmandGitHub 7038e8b803 [Kernel] Support running GPTQ 8-bit models in Marlin (#4533) 2024-05-02 12:56:22 -04:00
Robert ShawGitHubalexmmgoin
 		73c8d677e5 [Kernel] Marlin Expansion: Support AutoGPTQ Models with Marlin (#3922) 
Co-authored-by: alexm <alexm@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
 2024-04-29 09:35:34 -07:00