wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-20 12:40:26 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
bf3b79efb82676219a3275764d8fcf4c70097ce5
vllm/docs/source/api/inference_params.md
T
Cyrus LeungandGitHub 65097ca0af [Doc] Add model development API Reference (#11884) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2025-01-09 09:43:40 +00:00

281 B
Raw Blame History

Inference Parameters

Inference parameters for vLLM APIs.

(sampling-params)=

Sampling Parameters

.. autoclass:: vllm.SamplingParams
    :members:

(pooling-params)=

Pooling Parameters

.. autoclass:: vllm.PoolingParams
    :members:
Reference in New Issue View Git Blame Copy Permalink