wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-15 11:28:07 +08:00
Code Issues Packages Projects Releases Wiki Activity
619 Commits 1 Branch 0 Tags
fd4ea8ef5c17a8b991107402a414f6ed355d854d
Commit Graph
9 Commits
Author SHA1 Message Date
Zhuohan LiandGitHub fd4ea8ef5c Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221) 2024-01-03 11:30:22 -08:00
Jee LiandGitHub 77af974b40 [FIX] Support non-zero CUDA devices in custom kernels (#1959) 2024-01-02 19:09:59 -08:00
Yanming WandGitHub e0c6f556e8 [Build] Avoid building too many extensions (#1624) 2023-11-23 16:31:19 -08:00
Woosuk KwonandGitHub 0ce8647dc5 Fix integer overflows in attention & cache ops (#1514) 2023-10-31 15:19:30 -07:00
Zhuohan LiandGitHub ba0bfd40e2 TP/quantization/weight loading refactor part 1 - Simplify parallel linear logic (#1181) 2023-10-02 15:36:09 -07:00
Woosuk KwonandGitHub fbd80ad409 Clean up kernel unit tests (#938) 2023-09-05 16:57:38 -07:00
Zhuohan LiandGitHub d6fa1be3a8 [Quality] Add code formatter and linter (#326) 2023-07-03 11:31:55 -07:00
Woosuk KwonandGitHub 0b98ba15c7 Change the name to vLLM (#150) 2023-06-17 03:07:40 -07:00
Woosuk KwonandGitHub 825d8892b5 Use pytest format for unit tests (#107) 2023-05-17 17:11:23 -07:00