Add Yi model to quantization support (#1600) · ab9e8488d5 - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-26 13:37:27 +08:00

Add Yi model to quantization support (#1600)

This commit is contained in:

forpanyang

2023-11-09 11:47:14 -08:00

committed by

GitHub

parent fd58b73a40

commit ab9e8488d5

1 changed files with 1 additions and 0 deletions

									
										vllm/model_executor/model_loader.py
									
		+1
		
												View File
												
				@@ -41,6 +41,7 @@ _MODEL_REGISTRY = {

				_MODEL_CLASSES_SUPPORT_QUANTIZATION = [

				    LlamaForCausalLM,

				    MistralForCausalLM,

				    YiForCausalLM,

				]