mirror of
https://github.com/wassname/vllm.git
synced 2026-06-28 02:32:07 +08:00
Cyrus Leung
22 lines
281 B
Markdown
22 lines
281 B
Markdown
# Inference Parameters
|
|
|
|
Inference parameters for vLLM APIs.
|
|
|
|
(sampling-params)=
|
|
|
|
## Sampling Parameters
|
|
|
|
```{eval-rst}
|
|
.. autoclass:: vllm.SamplingParams
|
|
:members:
|
|
```
|
|
|
|
(pooling-params)=
|
|
|
|
## Pooling Parameters
|
|
|
|
```{eval-rst}
|
|
.. autoclass:: vllm.PoolingParams
|
|
:members:
|
|
```
|