wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-10 01:57:09 +08:00
Code Issues Packages Projects Releases Wiki Activity
822 Commits 1 Branch 0 Tags
76e8a70476ef9daa970349c14c117fe91e8b4544
Commit Graph

4 Commits

Author SHA1 Message Date
Woosuk Kwon d6e4a130b0 [Minor] Remove gather_cached_kv kernel (#3043) 2024-02-26 15:00:54 -08:00
zhaoyang-star 9090bf02e7 Support FP8-E5M2 KV Cache (#2279) 
Co-authored-by: zhaoyang <zhao.yang16@zte.com.cn>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
 2024-01-28 16:43:54 -08:00
Mingcan Xiang 614856da25 Avoid multiple redefinition (#1817) 2023-12-14 09:35:58 -08:00
Yanming W e0c6f556e8 [Build] Avoid building too many extensions (#1624) 2023-11-23 16:31:19 -08:00