wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-05 20:34:15 +08:00
Code Issues Packages Projects Releases Wiki Activity
981 Commits 1 Branch 0 Tags
515386ef3cacb44a2bcfab9d66eaee6143d94e95
Commit Graph

3 Commits

Author SHA1 Message Date
SangBin Cho 01bfb22b41 [CI] Try introducing isort. (#3495) 2024-03-25 07:59:47 -07:00
Antoni Baum bfdb1ba5c3 [Core] Improve detokenization performance for prefill (#3469) 
Co-authored-by: MeloYang <meloyang05@gmail.com>
 2024-03-22 13:44:12 -07:00
Antoni Baum fb96c1e98c Asynchronous tokenization (#2879) 2024-03-15 23:37:01 +00:00