Lucas Wilkinson 288cc6c234 [Attention] MLA with chunked prefill (#12639) ...

Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Patrick Horn <patrick.horn@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

2025-02-21 15:30:12 -08:00

..

aqlm

[Kernel] fix types used in aqlm and ggml kernels to support dynamo (#7596)

2024-08-16 14:00:11 -07:00

awq

[Kernel] Fix awq error when n is not divisable by 128 (#13227)

2025-02-13 20:07:05 -08:00

compressed_tensors

[MISC] Replace c10::optional with std::optional (#11730)

2025-01-05 10:20:34 +09:00

cutlass_w8a8

[Attention] MLA with chunked prefill (#12639)

2025-02-21 15:30:12 -08:00

fp4

[NVIDIA] Fix an issue to use current stream for the nvfp4 quant (#13632)

2025-02-20 22:01:48 -08:00

fp8

[ROCm] MI300A compile targets deprecation (#13560)

2025-02-19 23:05:00 -08:00

fused_kernels

[torch.compile] Dynamic fp8 + rms_norm fusion (#10906)

2024-12-13 03:19:23 +00:00

gguf

Missing comment explaining VDR variable in GGUF kernels (#13290)

2025-02-20 22:06:54 -08:00

gptq

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047)

2024-06-09 16:23:30 -04:00

gptq_marlin

Update pre-commit hooks (#12475)

2025-01-27 17:23:08 -07:00

machete

[CI/Build] Auto-fix Markdown files (#12941)

2025-02-08 04:25:15 -08:00

marlin

Update pre-commit hooks (#12475)

2025-01-27 17:23:08 -07:00

vectorization.cuh

[torch.compile] Dynamic fp8 + rms_norm fusion (#10906)

2024-12-13 03:19:23 +00:00