wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-02 07:40:18 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,774 Commits 1 Branch 0 Tags
db986c19ea35d7f3522a45d5205bf5d3ffab14e4
Commit Graph

3 Commits

Author SHA1 Message Date
Gregory Shtrasberg e97f802b2d [FP8][Kernel] Dynamic kv cache scaling factors computation (#11906) 
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
 2025-01-23 18:04:03 +00:00
Charlie Fu 9cc373f390 [Kernel][Amd] Add fp8 kv cache support for rocm custom paged attention (#8577) 2024-09-19 17:37:57 +00:00
Charlie Fu 1ef0d2efd0 [Kernel][Hardware][Amd]Custom paged attention kernel for rocm (#8310) 2024-09-13 17:01:11 -07:00