wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-06-28 02:32:07 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
ca2ca8de57227706e7833f91fc5459817dba9bd2
vllm/docs/source/api/inference_params.md
T
Cyrus Leung 65097ca0af [Doc] Add model development API Reference (#11884) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2025-01-09 09:43:40 +00:00

281 B
Raw Blame History

Inference Parameters

Inference parameters for vLLM APIs.

(sampling-params)=

Sampling Parameters

.. autoclass:: vllm.SamplingParams
    :members:

(pooling-params)=

Pooling Parameters

.. autoclass:: vllm.PoolingParams
    :members:
Reference in New Issue View Git Blame Copy Permalink