wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-16 11:23:03 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,137 Commits 1 Branch 0 Tags
2f4e108f75c817bf2f323e306db590e13d2863f6
Commit Graph
4 Commits
Author SHA1 Message Date
Tyler Michael SmithandGitHub fea59c7712 [Bugfix][Kernel] Use int64_t for indices in fp8 quant kernels (#6649) 2024-07-22 14:08:30 -06:00
Varun Sundar RabindranathGitHubVarun Sundar Rabindranth
 		2e26564259 [ Kernel ] FP8 Dynamic Per Token Quant - Add scale_ub (#6593) 
Co-authored-by: Varun Sundar Rabindranth <varun@neuralmagic.com>
 2024-07-19 18:15:26 -07:00
Robert ShawandGitHub 4cc24f01b1 [ Kernel ] Enable Dynamic Per Token fp8 (#6547) 2024-07-19 23:08:15 +00:00
Varun Sundar RabindranathGitHubVarun Sundar Rabindranath
 		b5241e41d9 [ Kernel ] FP8 Dynamic-Per-Token Quant Kernel (#6511) 
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
 2024-07-18 01:38:35 +00:00