vllm/csrc/quantization at ecdb462c2493cf9fd095e624cdfd8d62842e2097 - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-01 15:29:13 +08:00

Files

T

History

Varun Sundar Rabindranath b5241e41d9 [ Kernel ] FP8 Dynamic-Per-Token Quant Kernel (#6511 )

Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

2024-07-18 01:38:35 +00:00

..

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

compressed_tensors

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel] Turn off CUTLASS scaled_mm for Ada Lovelace (#6384 )

2024-07-14 13:37:19 +00:00

[ Kernel ] FP8 Dynamic-Per-Token Quant Kernel (#6511 )

2024-07-18 01:38:35 +00:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Bugfix] Fix CUDA version check for mma warning suppression (#5642 )

2024-06-18 23:48:49 +00:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00