mirror of
https://github.com/wassname/vllm.git
synced 2026-06-27 22:24:35 +08:00
Cyrus Leung
23 lines
280 B
Markdown
23 lines
280 B
Markdown
# Optional Parameters
|
|
|
|
Optional parameters for vLLM APIs.
|
|
|
|
(sampling-params)=
|
|
|
|
## Sampling Parameters
|
|
|
|
```{eval-rst}
|
|
.. autoclass:: vllm.SamplingParams
|
|
:members:
|
|
```
|
|
|
|
(pooling-params)=
|
|
|
|
## Pooling Parameters
|
|
|
|
```{eval-rst}
|
|
.. autoclass:: vllm.PoolingParams
|
|
:members:
|
|
```
|
|
|