vllm/vllm/model_executor/models at df845b2b46c3e30f5bd3e3be286285ed148323fc - vllm

__init__.py

[VLM] Refactor MultiModalConfig initialization and profiling (#7530 )

2024-08-17 13:30:55 -07:00

arctic.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

baichuan.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

bart.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

blip2.py

[Core] Optimize SPMD architecture with delta + serialization optimization (#7109 )

2024-08-18 17:57:20 -07:00

blip.py

[Core] Optimize SPMD architecture with delta + serialization optimization (#7109 )

2024-08-18 17:57:20 -07:00

bloom.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

chameleon.py

[Core] Optimize SPMD architecture with delta + serialization optimization (#7109 )

2024-08-18 17:57:20 -07:00

chatglm.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

clip.py

[Core] Optimize SPMD architecture with delta + serialization optimization (#7109 )

2024-08-18 17:57:20 -07:00

commandr.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

dbrx.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

decilm.py

[Model] Add base class for LoRA-supported models (#5018 )

2024-06-27 16:03:04 +08:00

deepseek_v2.py

[Misc] Update Fused MoE weight loading (#7334 )

2024-08-13 14:57:45 -04:00

deepseek.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

falcon.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

fuyu.py

[Core] Optimize SPMD architecture with delta + serialization optimization (#7109 )

2024-08-18 17:57:20 -07:00

gemma2.py

[Misc] Remove Gemma RoPE (#7638 )

2024-08-19 09:29:31 -07:00

gemma.py

[Misc] Remove Gemma RoPE (#7638 )

2024-08-19 09:29:31 -07:00

gpt2.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

gpt_bigcode.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

gpt_j.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

gpt_neox.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

idefics2_vision_model.py

[Model]Refactor MiniCPMV (#7020 )

2024-08-04 08:12:41 +00:00

interfaces.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126 )

2024-08-14 17:55:42 +00:00

intern_vit.py

[Model] Refactor and decouple weight loading logic for InternVL2 model (#7067 )

2024-08-02 22:36:14 -07:00

internlm2.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

internvl.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126 )

2024-08-14 17:55:42 +00:00

jais.py

[Model] Pipeline parallel support for JAIS (#7603 )

2024-08-17 11:11:09 -07:00

jamba.py

[Kernel] W8A16 Int8 inside FusedMoE (#7415 )

2024-08-16 10:06:51 -07:00

llama_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734 )

2024-05-11 11:30:37 -07:00

llama.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

llava_next.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126 )

2024-08-14 17:55:42 +00:00

llava.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126 )

2024-08-14 17:55:42 +00:00

medusa.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

minicpm.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

minicpmv.py

[Core] Optimize SPMD architecture with delta + serialization optimization (#7109 )

2024-08-18 17:57:20 -07:00

mixtral_quant.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

mixtral.py

[Misc] Update Fused MoE weight loading (#7334 )

2024-08-13 14:57:45 -04:00

mlp_speculator.py

[Bugfix] Fix speculative decoding with MLPSpeculator with padded vocabulary (#7218 )

2024-08-08 22:08:46 -07:00

mpt.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

na_vit.py

[Model]Refactor MiniCPMV (#7020 )

2024-08-04 08:12:41 +00:00

nemotron.py

[Model] Align nemotron config with final HF state and fix lm-eval-small (#7611 )

2024-08-16 15:56:34 -07:00

olmo.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

opt.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

orion.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

paligemma.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126 )

2024-08-14 17:55:42 +00:00

persimmon.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

phi3_small.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

phi3v.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126 )

2024-08-14 17:55:42 +00:00

phi.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

qwen2_moe.py

[Misc] Update Fused MoE weight loading (#7334 )

2024-08-13 14:57:45 -04:00

qwen2.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

qwen.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

siglip.py

[Core] Optimize SPMD architecture with delta + serialization optimization (#7109 )

2024-08-18 17:57:20 -07:00

stablelm.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

starcoder2.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00

utils.py

[Frontend][Core] Add plumbing to support audio language models (#7446 )

2024-08-13 17:39:33 +00:00

xverse.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410 )

2024-08-13 05:33:41 +00:00