wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-04 12:49:35 +08:00
Code Issues Packages Projects Releases Wiki Activity
69 Commits 1 Branch 0 Tags
53f70e73344a67f61b80feab03834a770bfb671b
Commit Graph

5 Commits

Author SHA1 Message Date
Woosuk Kwon 1ce1333573 Set default dtype to half 2023-02-23 21:31:39 +00:00
Woosuk Kwon fdd0f2f472 Minor 2023-02-23 20:23:47 +00:00
Woosuk Kwon 343cea3dbc Add seq_ids to input metadata 2023-02-23 09:25:01 +00:00
Woosuk Kwon 4b1ac23f53 Fix slot mapping 2023-02-23 00:10:07 +00:00
Woosuk Kwon 8290fce47d Add Worker class 2023-02-22 19:01:38 +00:00