wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-18 12:50:17 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,103 Commits 1 Branch 0 Tags
c9f09a4fe83ef13824ea1663214ac7aad08d2b31
Commit Graph
5 Commits
Author SHA1 Message Date
kliuaeandGitHub 7c25fe45a6 [AMD] Add support for GGUF quantization on ROCm (#10254) 2024-11-22 21:14:49 -08:00
sasha0552andGitHub 781e3b9a42 [Bugfix][Kernel] Fix build for sm_60 in GGUF kernel (#8506) 2024-09-16 12:15:57 -06:00
Isotr0pyandGitHub fc990f9795 [Bugfix][Kernel] Add IQ1_M quantization implementation to GGUF kernel (#8357) 2024-09-15 16:51:44 -06:00
bnellnmandGitHub 37fd47e780 [Kernel] fix types used in aqlm and ggml kernels to support dynamo (#7596) 2024-08-16 14:00:11 -07:00
Isotr0pyGitHubMichael Goin
 		360bd67cf0 [Core] Support loading GGUF model (#5191) 
Co-authored-by: Michael Goin <michael@neuralmagic.com>
 2024-08-05 17:54:23 -06:00