wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-06 05:17:51 +08:00
Code Issues Packages Projects Releases Wiki Activity
88 Commits 1 Branch 0 Tags
a1b3de86cd6f27aeb299d45296a7409b8d2b7c0c
Commit Graph

7 Commits

Author SHA1 Message Date
Woosuk Kwon d359cda5fa Minor 2023-03-26 08:00:39 +00:00
Zhuohan Li 2f49f15585 Support tensor parallel (#2) 2023-03-21 13:45:42 -07:00
Woosuk Kwon cfae35b861 Add miscellaneous updates (#8) 2023-03-13 13:48:38 -07:00
Woosuk Kwon 1a7eb7da61 Support beam search & parallel generation (#7) 2023-03-10 09:58:21 -08:00
Woosuk Kwon de0fabbc5c Fix sampler 2023-02-23 20:30:12 +00:00
Woosuk Kwon fdd0f2f472 Minor 2023-02-23 20:23:47 +00:00
Woosuk Kwon b56b6ca0d6 Add greedy sampler 2023-02-23 09:26:09 +00:00