wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-09-11 12:51:01 +08:00
Code Issues Packages Projects Releases Wiki Activity

Remove AsyncLLMEngine busy loop, shield background task (#1059)

Browse Source
This commit is contained in:
Antoni Baum
2023-09-17 00:29:08 -07:00
committed by GitHub
parent e3e79e9e8a
commit ff36139ffc
4 changed files with 154 additions and 18 deletions
Download Patch File Download Diff File Expand all files Collapse all files
requirements-dev.txt
+1
View File
@@ -11,3 +11,4 @@ types-setuptools
# testing
pytest
pytest-forked
pytest-asyncio