vllm/docs/source/dev/offline_inference/llm_inputs.rst at 2fa4623d9e673faddb05018ac3f3d65780bb083d - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-06-29 01:29:07 +08:00

Files

T

Cyrus Leung 5ae5ed1e60 [Core] Consolidate prompt arguments to LLM engines (#4328 )

Co-authored-by: Roger Wang <ywang@roblox.com>

2024-05-28 13:29:31 -07:00

15 lines

278 B

ReStructuredText

Raw Blame History

 LLM Inputs
 ==========
 .. autodata:: vllm.inputs.PromptStrictInputs
 .. autoclass:: vllm.inputs.TextPrompt
     :show-inheritance:
     :members:
     :member-order: bysource
 .. autoclass:: vllm.inputs.TokensPrompt
     :show-inheritance:
     :members:
     :member-order: bysource