This website requires JavaScript.
Explore
Help
Register
Sign In
wassname
/
vllm
Watch
1
Star
0
Fork
0
mirror of
https://github.com/wassname/vllm.git
synced
2026-08-14 12:50:37 +08:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
Files
3b19e39dc59975c4240082a6b45f7c2a123b7164
vllm
/
csrc
/
quantization
/
cutlass_w8a8
T
History
Luka Govedič
and
Tyler Michael Smith
8d59dbb000
[Kernel] Add per-tensor and per-token AZP epilogues (
#5941
)
...
Co-authored-by: Tyler Michael Smith <
tyler@neuralmagic.com
>
2024-08-06 18:17:08 +00:00
..
broadcast_load_epilogue_c2x.hpp
[Kernel] Add per-tensor and per-token AZP epilogues (
#5941
)
2024-08-06 18:17:08 +00:00
broadcast_load_epilogue_c3x.hpp
[Kernel] Update CUTLASS to 3.5.1 (
#7085
)
2024-08-05 15:13:43 -04:00
common.hpp
[BugFix] [Kernel] Add Cutlass2x fallback kernels (
#5744
)
2024-06-23 21:07:11 +00:00
Epilogues.md
[Kernel] Add per-tensor and per-token AZP epilogues (
#5941
)
2024-08-06 18:17:08 +00:00
scaled_mm_c2x_sm75_dispatch.cuh
[Kernel] Tuned int8 Cutlass Kernels for SM75 (T4) (
#6996
)
2024-07-31 14:40:32 -07:00
scaled_mm_c2x_sm80_dispatch.cuh
[Kernel] Tuned FP8 Kernels for Ada Lovelace (
#6677
)
2024-07-29 09:42:35 -06:00
scaled_mm_c2x_sm89_fp8_dispatch.cuh
[Kernel] Tuned int8 kernels for Ada Lovelace (
#6848
)
2024-07-29 20:24:58 -06:00
scaled_mm_c2x_sm89_int8_dispatch.cuh
[Kernel] Tuned int8 kernels for Ada Lovelace (
#6848
)
2024-07-29 20:24:58 -06:00
scaled_mm_c2x.cu
[Kernel] Add per-tensor and per-token AZP epilogues (
#5941
)
2024-08-06 18:17:08 +00:00
scaled_mm_c2x.cuh
[Kernel] Add per-tensor and per-token AZP epilogues (
#5941
)
2024-08-06 18:17:08 +00:00
scaled_mm_c3x.cu
[Kernel] Add per-tensor and per-token AZP epilogues (
#5941
)
2024-08-06 18:17:08 +00:00
scaled_mm_entry.cu
[Kernel] Add per-tensor and per-token AZP epilogues (
#5941
)
2024-08-06 18:17:08 +00:00