vllm/csrc/quantization at f952bbc8ffccdd109b5bd8936655ce3fe3220807 - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-04 15:07:20 +08:00

Files

T

History

Varun Sundar Rabindranath 2e26564259 [ Kernel ] FP8 Dynamic Per Token Quant - Add scale_ub (#6593 )

Co-authored-by: Varun Sundar Rabindranth <varun@neuralmagic.com>

2024-07-19 18:15:26 -07:00

..

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

compressed_tensors

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel] Turn off CUTLASS scaled_mm for Ada Lovelace (#6384 )

2024-07-14 13:37:19 +00:00

[ Kernel ] FP8 Dynamic Per Token Quant - Add scale_ub (#6593 )

2024-07-19 18:15:26 -07:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Bugfix] Fix CUDA version check for mma warning suppression (#5642 )

2024-06-18 23:48:49 +00:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00