wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-07 11:30:39 +08:00
Code Issues Packages Projects Releases Wiki Activity

[DOC] Add additional comments for LLMEngine and AsyncLLMEngine (#1011)

Browse Source
This commit is contained in:
Jiaxiang
2024-01-11 19:26:49 -08:00
committed by GitHub
parent 50376faa7b
commit 6549aef245
9 changed files with 242 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/source/dev/engine/async_llm_engine.rst
+7
View File
@@ -0,0 +1,7 @@
AsyncLLMEngine
=================================
.. autoclass:: vllm.engine.async_llm_engine.AsyncLLMEngine
:members: generate, abort
:show-inheritance: