Jiaxin Shan fc601665eb [Misc] Update disaggregation benchmark scripts and test logs (#11456) ...

Signed-off-by: Jiaxin Shan <seedjeffwan@gmail.com>

2024-12-25 06:58:48 +00:00

..

async_engine

…

basic_correctness

[V1] Unify VLLM_ENABLE_V1_MULTIPROCESSING handling in RayExecutor (#11472)

2024-12-24 19:49:46 -08:00

compile

…

core

…

data

…

distributed

…

encoder_decoder

…

engine

…

entrypoints

[Frontend] Online Pooling API (#11457)

2024-12-24 17:54:30 +08:00

fp8_kv

…

kernels

[Bugfix][Build/CI] Fix sparse CUTLASS compilation on CUDA [12.0, 12.2) (#11311)

2024-12-19 02:43:30 +00:00

kv_transfer

[Misc] Update disaggregation benchmark scripts and test logs (#11456)

2024-12-25 06:58:48 +00:00

lora

[Bugfix] Fix Qwen2-VL LoRA weight loading (#11430)

2024-12-24 09:56:10 +00:00

metrics

…

model_executor

[CI] Expand test_guided_generate to test all backends (#11313)

2024-12-19 04:00:38 +00:00

models

[Model] Automatic conversion of classification and reward models (#11469)

2024-12-24 18:22:22 +00:00

mq_llm_engine

…

multi_step

…

multimodal

…

plugins/vllm_add_dummy_model

[Misc] Move weights mapper (#11443)

2024-12-24 13:05:25 +00:00

prefix_caching

…

prompt_adapter

…

prompts

…

quantization

[Misc] add w8a8 asym models (#11075)

2024-12-23 13:33:20 -05:00

runai_model_streamer

[Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192)

2024-12-20 16:46:24 +00:00

samplers

[Bugfix] Fix spec decoding when seed is none in a batch (#10863)

2024-12-20 05:15:31 +00:00

spec_decode

…

standalone_tests

…

tensorizer_loader

…

tokenization

…

tool_use

[Model] IBM Granite 3.1 (#11307)

2024-12-19 11:27:24 +08:00

tpu

…

tracing

…

v1

…

vllm_test_utils

…

weight_loading

[Kernel]: Cutlass 2:4 Sparsity + FP8/Int8 Quant Support (#10995)

2024-12-18 09:57:16 -05:00

worker

…

__init__.py

…

conftest.py

…

test_cache_block_hashing.py

…

test_config.py

…

test_embedded_commit.py

…

test_inputs.py

…

test_logger.py

…

test_logits_processor.py

…

test_regression.py

…

test_sampling_params.py

…

test_scalartype.py

…

test_sequence.py

…

test_sharded_state_loader.py

…

test_utils.py

…

utils.py

…