sroy745 f6778620a9 Disable spec-decode + chunked-prefill for draft models with tensor parallelism > 1 (#10136) ...

Signed-off-by: Sourashis Roy <sroy@roblox.com>

2024-11-08 15:56:18 +00:00

..

__init__.py

[Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951)

2024-04-23 08:02:36 +00:00

conftest.py

[MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510)

2024-10-18 14:30:55 -07:00

test_compatibility.py

Disable spec-decode + chunked-prefill for draft models with tensor parallelism > 1 (#10136)

2024-11-08 15:56:18 +00:00

test_eagle_correctness.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00

test_integration_dist_tp2.py

[Hardware][ROCM] using current_platform.is_rocm (#9642)

2024-10-28 04:07:00 +00:00

test_integration_dist_tp4.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00

test_integration.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00

test_logprobs.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00

test_medusa_correctness.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00

test_mlp_correctness.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00

test_multistep_correctness.py

[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291)

2024-11-07 08:15:14 -08:00

test_ngram_correctness.py

[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291)

2024-11-07 08:15:14 -08:00

test_seed.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00