This website requires JavaScript.
Explore
Help
Register
Sign In
wassname
/
vllm
Watch
1
Star
0
Fork
0
mirror of
https://github.com/wassname/vllm.git
synced
2026-08-14 12:50:37 +08:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
Files
2dd34371a6054966d30971dae89b0c431d7f0f08
vllm
/
csrc
/
quantization
/
cutlass_w8a8
T
History
Varun Sundar Rabindranath
and
Varun Sundar Rabindranath
35e9c12bfa
[Kernel] Tuned int8 Cutlass Kernels for SM75 (T4) (
#6996
)
...
Co-authored-by: Varun Sundar Rabindranath <
varun@neuralmagic.com
>
2024-07-31 14:40:32 -07:00
..
broadcast_load_epilogue_c2x.hpp
[Kernel] Refactor CUTLASS kernels to always take scales that reside on the GPU (
#5137
)
2024-06-01 06:45:32 +00:00
broadcast_load_epilogue_c3x.hpp
[Bug Fix] Illegal memory access, FP8 Llama 3.1 405b (
#6852
)
2024-07-27 02:27:44 +00:00
common.hpp
[BugFix] [Kernel] Add Cutlass2x fallback kernels (
#5744
)
2024-06-23 21:07:11 +00:00
scaled_mm_c2x_sm75_dispatch.cuh
[Kernel] Tuned int8 Cutlass Kernels for SM75 (T4) (
#6996
)
2024-07-31 14:40:32 -07:00
scaled_mm_c2x_sm80_dispatch.cuh
[Kernel] Tuned FP8 Kernels for Ada Lovelace (
#6677
)
2024-07-29 09:42:35 -06:00
scaled_mm_c2x_sm89_fp8_dispatch.cuh
[Kernel] Tuned int8 kernels for Ada Lovelace (
#6848
)
2024-07-29 20:24:58 -06:00
scaled_mm_c2x_sm89_int8_dispatch.cuh
[Kernel] Tuned int8 kernels for Ada Lovelace (
#6848
)
2024-07-29 20:24:58 -06:00
scaled_mm_c2x.cu
[Kernel] Tuned int8 Cutlass Kernels for SM75 (T4) (
#6996
)
2024-07-31 14:40:32 -07:00
scaled_mm_c2x.cuh
[Kernel] Tuned FP8 Kernels for Ada Lovelace (
#6677
)
2024-07-29 09:42:35 -06:00
scaled_mm_c3x.cu
[Bugfix] Fix compute datatype for cutlass 3.x epilogues (
#5931
)
2024-06-28 17:10:34 +00:00
scaled_mm_entry.cu
[Kernel] Enable FP8 Cutlass for Ada Lovelace (
#6950
)
2024-07-31 14:40:22 -07:00