wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-08 03:15:43 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,336 Commits 1 Branch 0 Tags
6fc5b0f249396c6fb3a63b3175cd9892e7fedd9b
Commit Graph

3 Commits

Author SHA1 Message Date
jon-chuang 50b8d08dbd [Misc/Testing] Use torch.testing.assert_close (#7324) 2024-08-16 04:24:04 +00:00
Varun Sundar Rabindranath 2e26564259 [ Kernel ] FP8 Dynamic Per Token Quant - Add scale_ub (#6593) 
Co-authored-by: Varun Sundar Rabindranth <varun@neuralmagic.com>
 2024-07-19 18:15:26 -07:00
Varun Sundar Rabindranath b5241e41d9 [ Kernel ] FP8 Dynamic-Per-Token Quant Kernel (#6511) 
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
 2024-07-18 01:38:35 +00:00