wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-15 11:28:07 +08:00
Code Issues Packages Projects Releases Wiki Activity
924 Commits 1 Branch 0 Tags
6ebd02bdef1eb08f9a7a11253a26cd49b5fb6d2d
Commit Graph
6 Commits
Author SHA1 Message Date
Antoni BaumandGitHub fb96c1e98c Asynchronous tokenization (#2879) 2024-03-15 23:37:01 +00:00
ElizaWszolaandGitHub b35cc93420 Fix auto prefix bug (#3239) 2024-03-07 16:37:28 -08:00
Simon MoandGitHub 5ffc0d13a2 Migrate linter from pylint to ruff (#1665) 2023-11-20 11:58:01 -08:00
Zhuohan LiandGitHub ba0bfd40e2 TP/quantization/weight loading refactor part 1 - Simplify parallel linear logic (#1181) 2023-10-02 15:36:09 -07:00
Antoni BaumandGitHub dd54a4b026 Fix detokenization leaving special tokens (#1044) 
Signed-off-by: Antoni Baum <antoni.baum@protonmail.com>
 2023-09-14 16:37:03 -07:00
Antoni BaumandGitHub 9841d48a10 Use TGI-like incremental detokenization (#984) 2023-09-13 13:38:01 -07:00