wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-06-29 00:56:57 +08:00
Code Issues Packages Projects Releases Wiki Activity
116 Commits 1 Branch 0 Tags
e548c1488ae1e93b5ca60359f4b292d2bee0b60d
Commit Graph

3 Commits

Author SHA1 Message Date
Woosuk Kwon 12659a0bd7 Add CUDA graph-based all reduce launcher (#26) 2023-04-05 11:16:57 -07:00
Zhuohan Li c45f3c3ab6 Optimize tensor parallel execution speed (#17) 2023-04-01 00:51:08 +08:00
Zhuohan Li 2f49f15585 Support tensor parallel (#2) 2023-03-21 13:45:42 -07:00