Kuntai Du 81ede99ca4 [Core] Deprecating block manager v1 and make block manager v2 default (#8704) ...

Removing the block manager v1. This is the initial piece of prefix-caching-centric design. In order to achieve prefix-caching-centric design, we need to simplify the code path so that we only use v2 block manager (which has much higher performance on prefix caching).

2024-10-17 11:38:15 -05:00

..

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

test_basic_correctness.py

[CI/Build] Reorganize models tests (#7820)

2024-09-13 10:20:06 -07:00

test_chunked_prefill.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00

test_cpu_offload.py

[CI] Move quantization cpu offload tests out of fastcheck (#7574)

2024-08-15 21:16:20 -07:00

test_preemption.py

[core] remove beam search from the core (#9105)

2024-10-07 05:47:04 +00:00