wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-24 13:20:45 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,237 Commits 1 Branch 0 Tags
b38e42fbca978d62cc8330bdcf8da91c72cb2ebc
Commit Graph
11 Commits
Author SHA1 Message Date
SangBin ChoandGitHub 050f285ff6 [Core] Scheduling optimization 2 (#4280) 2024-04-23 08:02:11 +00:00
SangBin ChoandGitHub ad8d696a99 [Core] Scheduler perf fix (#4270) 2024-04-22 21:11:06 +00:00
SangBin ChoandGitHub 18de883489 [Chunked Prefill][4/n] Chunked prefill scheduler. (#3853) 2024-04-05 10:17:58 -07:00
SangBin ChoandGitHub 3dcb3e8b98 [3/N] Refactor scheduler for chunked prefill scheduling (#3550) 2024-04-03 14:13:49 -07:00
SangBin ChoandGitHub b51c1cc9d2 [2/N] Chunked prefill data update (#3538) 2024-03-28 10:06:01 -07:00
Cade DanielandGitHub 14ccd94c89 [Core][Bugfix]Refactor block manager for better testability (#3492) 2024-03-27 23:59:28 -07:00
SangBin ChoandGitHub 01bfb22b41 [CI] Try introducing isort. (#3495) 2024-03-25 07:59:47 -07:00
Thomas ParnellGitHubJan van Lunteren
 		cf2f084d56 Dynamic scheduler delay to improve ITL performance (#3279) 
Co-authored-by: Jan van Lunteren <jvl@zurich.ibm.com>
 2024-03-22 12:28:14 -07:00
SangBin ChoandGitHub 6e435de766 [1/n][Chunked Prefill] Refactor input query shapes (#3236) 2024-03-20 14:46:05 -07:00
Cade DanielandGitHub a33ce60c66 [Testing] Fix core tests (#3224) 2024-03-06 01:04:23 -08:00
SangBin ChoandGitHub 24aecf421a [Tests] Add block manager and scheduler tests (#3108) 2024-03-05 18:23:34 -08:00