10 Commits

Include renames

Author	SHA1	Message	Date
SangBin Cho	b51c1cc9d2	[2/N] Chunked prefill data update (#3538)	2024-03-28 10:06:01 -07:00
Cade Daniel	14ccd94c89	[Core][Bugfix]Refactor block manager for better testability (#3492)	2024-03-27 23:59:28 -07:00
SangBin Cho	01bfb22b41	[CI] Try introducing isort. (#3495)	2024-03-25 07:59:47 -07:00
Thomas ParnellandJan van Lunteren	cf2f084d56	Dynamic scheduler delay to improve ITL performance (#3279) ... Co-authored-by: Jan van Lunteren <jvl@zurich.ibm.com>	2024-03-22 12:28:14 -07:00
SangBin Cho	6e435de766	[1/n][Chunked Prefill] Refactor input query shapes (#3236)	2024-03-20 14:46:05 -07:00
ElizaWszolaandZhuohan Li	9474e89ba4	[PREFIX CACHING FOLLOW UP] A bunch of fixes to block allocator performance when automatic prefix caching is disabled (#3357) ... Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>	2024-03-20 00:11:11 -07:00
Breno Faria	49a3c8662b	Fixes #1556 double free (#3347)	2024-03-13 00:30:08 +00:00
Zhuohan Li	2f8844ba08	Re-enable the 80 char line width limit (#3305)	2024-03-10 19:49:14 -07:00
Cade Daniel	a33ce60c66	[Testing] Fix core tests (#3224)	2024-03-06 01:04:23 -08:00
SangBin Cho	24aecf421a	[Tests] Add block manager and scheduler tests (#3108)	2024-03-05 18:23:34 -08:00