wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-01 13:00:39 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,187 Commits 1 Branch 0 Tags
efffb63f584c1ce4fdcf4e7b7fd0bfc8b33a733a
Commit Graph
5 Commits
Author SHA1 Message Date
Antoni BaumandGitHub a10d3056da [Core] Set linear_weights directly on the layer (#3977) 2024-04-11 16:35:51 -04:00
CHU TianxiangandGitHub 01a5d18a53 Add Support for 2/3/8-bit GPTQ Quantization Models (#2330) 2024-02-28 21:52:23 -08:00
Woosuk KwonandGitHub 6ef00b03a2 Enable CUDA graph for GPTQ & SqueezeLLM (#2318) 2024-01-03 09:52:29 -08:00
kliuaeandGitHub 1b7c791d60 [ROCm] Fixes for GPTQ on ROCm (#2180) 2023-12-18 10:41:04 -08:00
CHU TianxiangandGitHub 0fbfc4b81b Add GPTQ support (#916) 2023-12-15 03:04:22 -08:00