wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-15 11:28:07 +08:00
Code Issues Packages Projects Releases Wiki Activity
723 Commits 1 Branch 0 Tags
2ccee3def6d8532afaf6fcd351b228ec1dfd6013
Commit Graph
3 Commits
Author SHA1 Message Date
zhaoyang-starGitHubzhaoyangZhuohan Li
 		9090bf02e7 Support FP8-E5M2 KV Cache (#2279) 
Co-authored-by: zhaoyang <zhao.yang16@zte.com.cn>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
 2024-01-28 16:43:54 -08:00
Jee LiandGitHub 77af974b40 [FIX] Support non-zero CUDA devices in custom kernels (#1959) 2024-01-02 19:09:59 -08:00
Woosuk KwonandGitHub fbd80ad409 Clean up kernel unit tests (#938) 2023-09-05 16:57:38 -07:00