wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-18 12:30:29 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Model] Adding support for MSFT Phi-3.5-MoE (#7729)

Browse Source 
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Zeqi Lin <zelin@microsoft.com>
Co-authored-by: Zeqi Lin <Zeqi.Lin@microsoft.com>
This commit is contained in:
Wenxiang
2024-08-30 13:42:57 -06:00
committed by GitHub
co-authored by Your Name Zeqi Lin Zeqi Lin
parent 2684efc467
commit 1248e8506a
13 changed files with 1254 additions and 81 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/source/models/supported_models.rst
+4
View File
@@ -147,6 +147,10 @@ Decoder-only Language Models
- Phi-3-Small
- :code:`microsoft/Phi-3-small-8k-instruct`, :code:`microsoft/Phi-3-small-128k-instruct`, etc.
-
* - :code:`PhiMoEForCausalLM`
- Phi-3.5-MoE
- :code:`microsoft/Phi-3.5-MoE-instruct`, etc.
-
* - :code:`PersimmonForCausalLM`
- Persimmon
- :code:`adept/persimmon-8b-base`, :code:`adept/persimmon-8b-chat`, etc.