mirror of https://github.com/wassname/vllm.git synced 2026-06-27 23:24:35 +08:00

Files

T

Harry Mellor dd6a3a02cb [Doc] Convert docs to use colon fences (#12471 )

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2025-01-29 11:38:29 +08:00

(engine-args)=

Engine Arguments

Below, you can find an explanation of every engine argument for vLLM:

.. argparse::
    :module: vllm.engine.arg_utils
    :func: _engine_args_parser
    :prog: vllm serve
    :nodefaultconst:

Async Engine Arguments

Below are the additional arguments related to the asynchronous engine:

.. argparse::
    :module: vllm.engine.arg_utils
    :func: _async_engine_args_parser
    :prog: vllm serve
    :nodefaultconst: