wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-02 08:14:17 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,988 Commits 1 Branch 0 Tags
30efe41532b7cd7202d128ffedfc703c4039767f
Commit Graph

1 Commits

Author SHA1 Message Date
Varun Sundar Rabindranath b5241e41d9 [ Kernel ] FP8 Dynamic-Per-Token Quant Kernel (#6511) 
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
 2024-07-18 01:38:35 +00:00