wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-14 11:19:39 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
2118d0565cb52c69e0bbacdcf48af9ecef39e528
vllm/docs/source/deployment/frameworks/triton.md
T
Cyrus LeungandGitHub 8ceffbf315 [Doc][3/N] Reorganize Serving section (#11766) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2025-01-07 11:20:01 +08:00

444 B
Raw Blame History

(deployment-triton)=

NVIDIA Triton

The Triton Inference Server hosts a tutorial demonstrating how to quickly deploy a simple facebook/opt-125m model using vLLM. Please see Deploying a vLLM model in Triton for more details.

Reference in New Issue View Git Blame Copy Permalink