Logo
Explore Help
Register Sign In
wassname/vllm
Watch 1
Star 0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-15 11:28:07 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
d88c458f44f5bc0d01215310f8abb5d63fa106d4
vllm/csrc/quantization
T
History
Tyler Michael SmithandGitHub fea59c7712 [Bugfix][Kernel] Use int64_t for indices in fp8 quant kernels (#6649)
2024-07-22 14:08:30 -06:00
..
aqlm
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047)
2024-06-09 16:23:30 -04:00
awq
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047)
2024-06-09 16:23:30 -04:00
compressed_tensors
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047)
2024-06-09 16:23:30 -04:00
cutlass_w8a8
[Kernel] Turn off CUTLASS scaled_mm for Ada Lovelace (#6384)
2024-07-14 13:37:19 +00:00
fp8
[Bugfix][Kernel] Use int64_t for indices in fp8 quant kernels (#6649)
2024-07-22 14:08:30 -06:00
gptq
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047)
2024-06-09 16:23:30 -04:00
gptq_marlin
[Kernel][Core] Add AWQ support to the Marlin kernel (#6612)
2024-07-21 19:41:42 -04:00
marlin
[Kernel][Core] Add AWQ support to the Marlin kernel (#6612)
2024-07-21 19:41:42 -04:00
squeezellm
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047)
2024-06-09 16:23:30 -04:00
Powered by Gitea Version: 1.27.0 Page: 27ms Template: 3ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API