Files
vllm/docs/source/serving/deploying_with_triton.md
T
2024-12-23 22:35:38 +00:00

463 B

(deploying-with-triton)=

Deploying with NVIDIA Triton

The Triton Inference Server hosts a tutorial demonstrating how to quickly deploy a simple facebook/opt-125m model using vLLM. Please see Deploying a vLLM model in Triton for more details.