mirror of
https://github.com/wassname/vllm.git
synced 2026-06-27 19:49:51 +08:00
ee77fdb5de
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
26 lines
495 B
Markdown
26 lines
495 B
Markdown
(engine-args)=
|
|
|
|
# Engine Arguments
|
|
|
|
Below, you can find an explanation of every engine argument for vLLM:
|
|
|
|
```{eval-rst}
|
|
.. argparse::
|
|
:module: vllm.engine.arg_utils
|
|
:func: _engine_args_parser
|
|
:prog: vllm serve
|
|
:nodefaultconst:
|
|
```
|
|
|
|
## Async Engine Arguments
|
|
|
|
Below are the additional arguments related to the asynchronous engine:
|
|
|
|
```{eval-rst}
|
|
.. argparse::
|
|
:module: vllm.engine.arg_utils
|
|
:func: _async_engine_args_parser
|
|
:prog: vllm serve
|
|
:nodefaultconst:
|
|
```
|