mirror of
https://github.com/wassname/vllm.git
synced 2026-06-28 04:56:24 +08:00
Harry Mellor
23 lines
549 B
ReStructuredText
23 lines
549 B
ReStructuredText
.. _engine_args:
|
|
|
|
Engine Arguments
|
|
================
|
|
|
|
Below, you can find an explanation of every engine argument for vLLM:
|
|
|
|
.. argparse::
|
|
:module: vllm.engine.arg_utils
|
|
:func: _engine_args_parser
|
|
:prog: -m vllm.entrypoints.openai.api_server
|
|
:nodefaultconst:
|
|
|
|
Async Engine Arguments
|
|
----------------------
|
|
|
|
Below are the additional arguments related to the asynchronous engine:
|
|
|
|
.. argparse::
|
|
:module: vllm.engine.arg_utils
|
|
:func: _async_engine_args_parser
|
|
:prog: -m vllm.entrypoints.openai.api_server
|
|
:nodefaultconst: |