wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-19 11:29:39 +08:00
Code Issues Packages Projects Releases Wiki Activity
664 Commits 1 Branch 0 Tags
5b23c3f26fcf08fdbe2b7e6beecb4d970e632897
Commit Graph
5 Commits
Author SHA1 Message Date
shiyi.c_98GitHubDouHappyZhuohan Li
 		d10f8e1d43 [Experimental] Prefix Caching Support (#1669) 
Co-authored-by: DouHappy <2278958187@qq.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
 2024-01-17 16:32:10 -08:00
Zhuohan LiandGitHub fd4ea8ef5c Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221) 2024-01-03 11:30:22 -08:00
Woosuk KwonandGitHub cd3aa153a4 Fix broken worker test (#1900) 2023-12-02 22:17:33 -08:00
Simon MoandGitHub 5ffc0d13a2 Migrate linter from pylint to ruff (#1665) 2023-11-20 11:58:01 -08:00
Yanming WandGitHub 8efe23f150 Fix input_metadata.selected_token_indices in worker prepare_inputs (#1546) 2023-11-08 14:19:12 -08:00