Tyler Michael SmithandYu Chin Fabian Lim 1f69c4a892 [Model] Support Mamba2 (Codestral Mamba) (#9292) ...

Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Yu Chin Fabian Lim <flim@sg.ibm.com>

2025-02-17 20:17:50 +08:00

..

async_engine

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

basic_correctness

[Core] Reduce TTFT with concurrent partial prefills (#10235)

2025-02-14 15:36:07 -08:00

compile

Consolidate Llama model usage in tests (#13094)

2025-02-13 22:18:03 -08:00

core

[Core] Reduce TTFT with concurrent partial prefills (#10235)

2025-02-14 15:36:07 -08:00

data

[Bugfix] Fix load config when using bools (#9533)

2024-10-27 13:46:41 -04:00

distributed

[Bugfix] Fix 2 Node and Spec Decode tests (#13341)

2025-02-16 22:20:22 +08:00

encoder_decoder

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

engine

[bugfix] respect distributed_executor_backend in world_size=1 (#12934)

2025-02-08 16:17:08 +08:00

entrypoints

[V1][Metrics] Add iteration_tokens_total histogram from V0 (#13288)

2025-02-15 03:56:19 -08:00

kernels

[ci] skip failed tests for flashinfer (#13352)

2025-02-16 22:09:15 +08:00

kv_transfer

Consolidate Llama model usage in tests (#13094)

2025-02-13 22:18:03 -08:00

lora

[V1] LoRA - Enable Serving Usecase (#12883)

2025-02-14 14:21:12 +08:00

metrics

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

mistral_tool_use

[Frontend] Generate valid tool call IDs when using tokenizer-mode=mistral (#12332)

2025-02-12 08:29:56 -08:00

model_executor

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

models

[Model] Support Mamba2 (Codestral Mamba) (#9292)

2025-02-17 20:17:50 +08:00

mq_llm_engine

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

multi_step

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

multimodal

[Bugfix] Clean up and fix multi-modal processors (#13012)

2025-02-10 10:45:21 +00:00

neuron

[Neuron][Kernel] Support Longer Sequences in NKI-based Flash PagedAttention and Improve Efficiency (#12921)

2025-02-11 21:12:37 -08:00

plugins

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

plugins_tests

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

prefix_caching

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

prompt_adapter

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

Consolidate Llama model usage in tests (#13094)

2025-02-13 22:18:03 -08:00

runai_model_streamer

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

samplers

Consolidate Llama model usage in tests (#13094)

2025-02-13 22:18:03 -08:00

spec_decode

[Feature][Spec Decode] Simplify the use of Eagle Spec Decode (#12304)

2025-02-16 19:32:26 -08:00

standalone_tests

make sure mistral_common not imported for non-mistral models (#12669)

2025-02-03 13:40:25 +08:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tensorizer_loader

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

tokenization

Consolidate Llama model usage in tests (#13094)

2025-02-13 22:18:03 -08:00

tool_use

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

tpu

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

tracing

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

v1

[V1][Spec Decode] Ngram Spec Decode (#12193)

2025-02-15 18:05:11 -08:00

vllm_test_utils

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

weight_loading

[Quant][Perf] Use moe_wna16 kernel by default for MoEs with many experts (#13236)

2025-02-14 12:53:42 -08:00

worker

[AMD][ROCm] Enable DeepSeek model on ROCm (#12662)

2025-02-04 08:24:11 +00:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

conftest.py

[Model] LoRA Support for Ultravox model (#11253)

2025-02-05 19:54:13 -08:00

test_cache_block_hashing.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

test_config.py

Consolidate Llama model usage in tests (#13094)

2025-02-13 22:18:03 -08:00

test_embedded_commit.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

test_inputs.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

test_logger.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

test_logits_processor.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

test_regression.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

test_sampling_params.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

test_scalartype.py

[NVIDIA] Support nvfp4 quantization (#12784)

2025-02-12 19:51:51 -08:00

test_seed_behavior.py

[Bugfix] fix flaky test (#13089)

2025-02-11 14:41:20 +00:00

test_sequence.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

test_sharded_state_loader.py

Consolidate Llama model usage in tests (#13094)

2025-02-13 22:18:03 -08:00

test_utils.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

utils.py

[core] port pynvml into vllm codebase (#12963)

2025-02-09 15:00:00 +08:00