3 people db66e018ea [Bugfix] Fix for Spec model TP + Chunked Prefill (#10232) ...

Signed-off-by: andoorve <37849411+andoorve@users.noreply.github.com>
Signed-off-by: Sourashis Roy <sroy@roblox.com>
Co-authored-by: Sourashis Roy <sroy@roblox.com>

2024-11-26 09:11:16 -08:00

..

__init__.py

[Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951)

2024-04-23 08:02:36 +00:00

conftest.py

[MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510)

2024-10-18 14:30:55 -07:00

test_compatibility.py

[Bugfix] Fix for Spec model TP + Chunked Prefill (#10232)

2024-11-26 09:11:16 -08:00

test_eagle_correctness.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00

test_integration_dist_tp2.py

[Bugfix] Fix for Spec model TP + Chunked Prefill (#10232)

2024-11-26 09:11:16 -08:00

test_integration_dist_tp4.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00

test_integration.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00

test_logprobs.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00

test_medusa_correctness.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00

test_mlp_correctness.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00

test_multistep_correctness.py

[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291)

2024-11-07 08:15:14 -08:00

test_ngram_correctness.py

[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291)

2024-11-07 08:15:14 -08:00

test_seed.py

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00