wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-18 12:50:17 +08:00
Code Issues Packages Projects Releases Wiki Activity
88 Commits 1 Branch 0 Tags
a1b3de86cd6f27aeb299d45296a7409b8d2b7c0c
Commit Graph
7 Commits
Author SHA1 Message Date
Zhuohan LiandGitHub 2f49f15585 Support tensor parallel (#2) 2023-03-21 13:45:42 -07:00
Woosuk KwonandGitHub 1a7eb7da61 Support beam search & parallel generation (#7) 2023-03-10 09:58:21 -08:00
Woosuk KwonandGitHub cbf8779afa Fix a bug in tying OPT embeddings (#1) 2023-02-24 16:29:36 -08:00
Woosuk Kwon de0fabbc5c Fix sampler 2023-02-23 20:30:12 +00:00
Woosuk Kwon 86f9eb6d39 Fix typo 2023-02-23 20:19:24 +00:00
Woosuk Kwon d4bc1a4d24 Add unoptimized OPT Attention 2023-02-23 09:31:55 +00:00
Woosuk Kwon 709a69176e Move worker/models -> models 2023-02-22 18:03:48 +00:00