Jun Duan 82fbeae92b [Misc] Accurately capture the time of loading weights (#14063) ...

Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>

2025-03-01 17:20:30 -08:00

..

adapter_commons

…

assets

…

attention

[core] Perf improvement for DSv3 on AMD GPUs (#13718)

2025-02-27 22:14:30 +00:00

compilation

[torch.compile] Fix RMSNorm + quant fusion in the non-cutlass-fp8 case, rename RedundantReshapesPass to NoopEliminationPass (#10902)

2025-02-28 16:20:11 -07:00

core

…

device_allocator

…

distributed

[Bugfix][Disaggregated] patch the inflight batching on the decode node in SimpleConnector to avoid hangs in SimpleBuffer (nccl based) (#13987)

2025-02-28 07:53:45 +00:00

engine

[V1][Minor] Restore V1 compatibility with LLMEngine class (#13090)

2025-02-28 00:52:25 -08:00

entrypoints

…

executor

[core] Bump ray to 2.43 (#13994)

2025-02-28 21:47:44 +00:00

inputs

[VLM] Deprecate legacy input mapper for OOT multimodal models (#13979)

2025-02-27 19:14:55 +00:00

logging_utils

…

lora

[Model] Add LoRA support for TransformersModel (#13770)

2025-03-02 09:17:34 +08:00

model_executor

[Misc] Accurately capture the time of loading weights (#14063)

2025-03-01 17:20:30 -08:00

multimodal

[VLM][Bugfix] Enable specifying prompt target via index (#14038)

2025-02-28 07:35:55 -08:00

platforms

[V1][Minor] Do not print attn backend twice (#13985)

2025-03-01 07:09:14 +00:00

plugins

…

profiler

…

prompt_adapter

…

spec_decode

[Model][Speculative Decoding] Expand DeepSeek MTP code to support k > n_predict (#13626)

2025-02-27 15:28:08 -08:00

third_party

…

transformers_utils

[Bugfix] Add file lock for ModelScope download (#14060)

2025-03-01 06:10:28 +00:00

triton_utils

…

usage

…

v1

[Misc] Accurately capture the time of loading weights (#14063)

2025-03-01 17:20:30 -08:00

vllm_flash_attn

…

worker

[Misc] Accurately capture the time of loading weights (#14063)

2025-03-01 17:20:30 -08:00

__init__.py

…

_custom_ops.py

[Misc][Kernel]: Add GPTQAllSpark Quantization (#12931)

2025-02-28 22:30:59 -08:00

_ipex_ops.py

…

beam_search.py

…

config.py

[torch.compile] Fix RMSNorm + quant fusion in the non-cutlass-fp8 case, rename RedundantReshapesPass to NoopEliminationPass (#10902)

2025-02-28 16:20:11 -07:00

connections.py

…

envs.py

[misc] Rename Ray ADAG to Compiled Graph (#13928)

2025-02-26 20:03:28 -08:00

forward_context.py

…

logger.py

…

logits_process.py

…

outputs.py

…

pooling_params.py

…

py.typed

…

sampling_params.py

…

scalar_type.py

…

scripts.py

…

sequence.py

…

test_utils.py

Use smaller embedding model when not testing model specifically (#13891)

2025-02-28 00:50:43 -08:00

tracing.py

…

utils.py

…

version.py

…