wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-09-09 11:40:01 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Bugfix] Add image placeholder for OpenAI Compatible Server of MiniCPM-V (#6787)

Browse Source 
Co-authored-by: hezhihui <hzh7269@modelbest.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
This commit is contained in:
Alphi
2024-07-25 09:42:49 -07:00
committed by GitHub
co-authored by hezhihui Cyrus Leung
parent 316a41ac1d
commit b75e314fff
2 changed files with 5 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
examples/minicpmv_example.py
+2
View File
@@ -4,6 +4,8 @@ from vllm import LLM, SamplingParams
from vllm.assets.image import ImageAsset
# 2.0
# The official repo doesn't work yet, so we need to use a fork for now
# For more details, please see: See: https://github.com/vllm-project/vllm/pull/4087#issuecomment-2250397630
# MODEL_NAME = "HwwwH/MiniCPM-V-2"
# 2.5
MODEL_NAME = "openbmb/MiniCPM-Llama3-V-2_5"