wassname/vllm
1
0 Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-10-01 12:42:39 +08:00
Code Issues Packages Projects Releases Wiki Activity

Add distributed model executor abstraction (#3191)

Browse Source
This commit is contained in:
Zhuohan Li authored and GitHub committed 2024-03-11 11:03:45 -07:00
1 parent 657061fdce
commit 4c922709b6
13 files changed
+817 -508
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/source/dev/engine/llm_engine.rst
+1 -1
View File
@@ -2,5 +2,5 @@ LLMEngine
=================================
.. autoclass:: vllm.engine.llm_engine.LLMEngine
:members: add_request, abort_request, step, _init_cache
:members: add_request, abort_request, step
:show-inheritance: