vllm/csrc/quantization at b5241e41d9fef56a89dcfda367a7eff87a07e3f7 - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-06-29 06:15:51 +08:00

Files

T

History

Varun Sundar Rabindranath b5241e41d9 [ Kernel ] FP8 Dynamic-Per-Token Quant Kernel (#6511 )

Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

2024-07-18 01:38:35 +00:00

..

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

compressed_tensors

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel] Turn off CUTLASS scaled_mm for Ada Lovelace (#6384 )

2024-07-14 13:37:19 +00:00

[ Kernel ] FP8 Dynamic-Per-Token Quant Kernel (#6511 )

2024-07-18 01:38:35 +00:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Bugfix] Fix CUDA version check for mma warning suppression (#5642 )

2024-06-18 23:48:49 +00:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00