wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-20 12:40:26 +08:00
Code Issues Packages Projects Releases Wiki Activity
663 Commits 1 Branch 0 Tags
00efdc84baf313cb775ca99a011b0e9a13539bdd
Commit Graph
3 Commits
Author SHA1 Message Date
shiyi.c_98GitHubDouHappyZhuohan Li
 		d10f8e1d43 [Experimental] Prefix Caching Support (#1669) 
Co-authored-by: DouHappy <2278958187@qq.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
 2024-01-17 16:32:10 -08:00
Zhuohan LiandGitHub fd4ea8ef5c Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221) 2024-01-03 11:30:22 -08:00
Woosuk KwonandGitHub cd3aa153a4 Fix broken worker test (#1900) 2023-12-02 22:17:33 -08:00