wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-14 12:50:37 +08:00
Code Issues Packages Projects Releases Wiki Activity
908 Commits 1 Branch 0 Tags
7341c77d693edcecf0a9f5a6e399c5137177dfba
Commit Graph
6 Commits
Author SHA1 Message Date
Antoni Baum fb96c1e98c Asynchronous tokenization (#2879) 2024-03-15 23:37:01 +00:00
ElizaWszola b35cc93420 Fix auto prefix bug (#3239) 2024-03-07 16:37:28 -08:00
Simon Mo 5ffc0d13a2 Migrate linter from pylint to ruff (#1665) 2023-11-20 11:58:01 -08:00
Zhuohan Li ba0bfd40e2 TP/quantization/weight loading refactor part 1 - Simplify parallel linear logic (#1181) 2023-10-02 15:36:09 -07:00
Antoni Baum dd54a4b026 Fix detokenization leaving special tokens (#1044) 
Signed-off-by: Antoni Baum <antoni.baum@protonmail.com>
 2023-09-14 16:37:03 -07:00
Antoni Baum 9841d48a10 Use TGI-like incremental detokenization (#984) 2023-09-13 13:38:01 -07:00