vllm/csrc/quantization at 7bd82002ae0e7ee8c4e5da0d43cfe0fd85372b4a - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-08-15 12:54:49 +08:00

Files

T

History

Varun Sundar RabindranathandVarun Sundar Rabindranth 2e26564259 [ Kernel ] FP8 Dynamic Per Token Quant - Add scale_ub (#6593 )

Co-authored-by: Varun Sundar Rabindranth <varun@neuralmagic.com>

2024-07-19 18:15:26 -07:00

..

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

compressed_tensors

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel] Turn off CUTLASS scaled_mm for Ada Lovelace (#6384 )

2024-07-14 13:37:19 +00:00

[ Kernel ] FP8 Dynamic Per Token Quant - Add scale_ub (#6593 )

2024-07-19 18:15:26 -07:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Bugfix] Fix CUDA version check for mma warning suppression (#5642 )

2024-06-18 23:48:49 +00:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00