wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-16 11:23:03 +08:00
Code Issues Packages Projects Releases Wiki Activity
964 Commits 1 Branch 0 Tags
d18f4e73f39a72bc2abe74bc6b02c61805e1c3d1
Commit Graph
8 Commits
Author SHA1 Message Date
SangBin ChoandGitHub 01bfb22b41 [CI] Try introducing isort. (#3495) 2024-03-25 07:59:47 -07:00
Thomas ParnellGitHubJan van Lunteren
 		cf2f084d56 Dynamic scheduler delay to improve ITL performance (#3279) 
Co-authored-by: Jan van Lunteren <jvl@zurich.ibm.com>
 2024-03-22 12:28:14 -07:00
SangBin ChoandGitHub 6e435de766 [1/n][Chunked Prefill] Refactor input query shapes (#3236) 2024-03-20 14:46:05 -07:00
ElizaWszolaGitHubZhuohan Li
 		9474e89ba4 [PREFIX CACHING FOLLOW UP] A bunch of fixes to block allocator performance when automatic prefix caching is disabled (#3357) 
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
 2024-03-20 00:11:11 -07:00
Breno FariaandGitHub 49a3c8662b Fixes #1556 double free (#3347) 2024-03-13 00:30:08 +00:00
Zhuohan LiandGitHub 2f8844ba08 Re-enable the 80 char line width limit (#3305) 2024-03-10 19:49:14 -07:00
Cade DanielandGitHub a33ce60c66 [Testing] Fix core tests (#3224) 2024-03-06 01:04:23 -08:00
SangBin ChoandGitHub 24aecf421a [Tests] Add block manager and scheduler tests (#3108) 2024-03-05 18:23:34 -08:00