3 people a046f86397 [Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208) ...

Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

2024-08-12 22:47:41 +00:00

..

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

abstract.py

[Misc] Support attention logits soft-capping with flash-attn (#7022)

2024-08-01 13:14:37 -07:00

blocksparse_attn.py

[Misc] Support attention logits soft-capping with flash-attn (#7022)

2024-08-01 13:14:37 -07:00

flash_attn.py

[Bugfix] Fix logit soft cap in flash-attn backend (#7425)

2024-08-12 09:58:28 -07:00

flashinfer.py

[Kernel] Flashinfer correctness fix for v0.1.3 (#7319)

2024-08-12 07:59:17 +00:00

ipex_attn.py

[Misc] Support attention logits soft-capping with flash-attn (#7022)

2024-08-01 13:14:37 -07:00

openvino.py

[Hardware][Intel] OpenVINO vLLM backend (#5379)

2024-06-28 13:50:16 +00:00

pallas.py

[Misc] Support attention logits soft-capping with flash-attn (#7022)

2024-08-01 13:14:37 -07:00

rocm_flash_attn.py

[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208)

2024-08-12 22:47:41 +00:00

torch_sdpa.py

[Misc] Support attention logits soft-capping with flash-attn (#7022)

2024-08-01 13:14:37 -07:00

utils.py

[Misc] Add numpy implementation of compute_slot_mapping (#7377)

2024-08-09 22:52:29 +00:00

xformers.py

[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208)

2024-08-12 22:47:41 +00:00