wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-06-28 21:48:21 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
db986c19ea35d7f3522a45d5205bf5d3ffab14e4
vllm/docs/source/deployment/integrations/kserve.md
T
Cyrus Leung 8ceffbf315 [Doc][3/N] Reorganize Serving section (#11766) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2025-01-07 11:20:01 +08:00

310 B
Raw Blame History

(deployment-kserve)=

KServe

vLLM can be deployed with KServe on Kubernetes for highly scalable distributed model serving.

Please see this guide for more details on using vLLM with KServe.

Reference in New Issue View Git Blame Copy Permalink