wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-14 11:19:39 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,044 Commits 1 Branch 0 Tags
1d7c940d74f4923f7507725598bcd08f0f1dbd2d
Commit Graph
11 Commits
Author SHA1 Message Date
Woosuk KwonandGitHub e66b629c04 [Misc] Minor fix in KVCache type (#3652) 2024-03-26 23:14:06 -07:00
Zhuohan LiandGitHub fd4ea8ef5c Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221) 2024-01-03 11:30:22 -08:00
Peter GötzandGitHub d940ce497e Fix typo in adding_model.rst (#1947) 
adpated -> adapted
 2023-12-06 10:04:26 -08:00
Simon MoandGitHub 0f621c2c7d [Docs] Add information about using shared memory in docker (#1845) 2023-11-29 18:33:56 -08:00
Zhuohan LiandGitHub 0fc280b06c Update the adding-model doc according to the new refactor (#1692) 2023-11-16 18:46:26 -08:00
Zhuohan LiandGitHub 002800f081 Align vLLM's beam search implementation with HF generate (#857) 2023-09-04 17:29:42 -07:00
Woosuk KwonandGitHub 794e578de0 [Minor] Fix URLs (#166) 2023-06-19 22:57:14 -07:00
Woosuk KwonandGitHub b7e62d3454 Fix repo & documentation URLs (#163) 2023-06-19 20:03:40 -07:00
Woosuk KwonandGitHub 0b98ba15c7 Change the name to vLLM (#150) 2023-06-17 03:07:40 -07:00
Woosuk KwonandGitHub 456941cfe4 [Docs] Write the Adding a New Model section (#138) 2023-06-05 20:01:26 -07:00
Woosuk KwonandGitHub 62ec38ea41 Document supported models (#127) 2023-06-02 22:35:17 -07:00