6 Commits

Author	SHA1	Message	Date
Nick Hill	5cf9254a9c	[BugFix] Fix use of per-request seed with pipeline parallel (#6698)	2024-07-30 10:40:08 -07:00
Alexander Matveev	3476ed0809	[Core] Optimize block_manager_v2 vs block_manager_v1 (to make V2 default) (#5602)	2024-07-01 20:10:37 -07:00
Cyrus Leung	0e9164b40a	[mypy] Enable type checking for test directory (#5017)	2024-06-15 04:45:31 +00:00
Cade Daniel	e5043a3e75	[Misc] Add pytest marker to opt-out of global test cleanup (#3863)	2024-04-04 21:54:16 -07:00
SangBin Cho	01bfb22b41	[CI] Try introducing isort. (#3495)	2024-03-25 07:59:47 -07:00
Cade Daniel	8437bae6ef	[Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (#3103)	2024-03-08 23:32:46 -08:00