vllm/csrc/quantization at 082ecd80d58c6604f44c0196cb9db5bc4befd6d7 - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-05 07:23:34 +08:00

Files

T

History

Varun Sundar Rabindranath 2e26564259 [ Kernel ] FP8 Dynamic Per Token Quant - Add scale_ub (#6593 )

Co-authored-by: Varun Sundar Rabindranth <varun@neuralmagic.com>

2024-07-19 18:15:26 -07:00

..

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

compressed_tensors

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel] Turn off CUTLASS scaled_mm for Ada Lovelace (#6384 )

2024-07-14 13:37:19 +00:00

[ Kernel ] FP8 Dynamic Per Token Quant - Add scale_ub (#6593 )

2024-07-19 18:15:26 -07:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Bugfix] Fix CUDA version check for mma warning suppression (#5642 )

2024-06-18 23:48:49 +00:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00