vllm/tests/async_engine at cf5cb1e33eed16b2f0d5fe6268bf5705a4d0ea5a - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-02 19:24:18 +08:00

Files

T

History

Antoni Baum ff36139ffc Remove AsyncLLMEngine busy loop, shield background task (#1059 )

2023-09-17 00:29:08 -07:00

..

api_server_async_engine.py

Start background task in AsyncLLMEngine.generate (#988 )

2023-09-08 00:03:39 -07:00

test_api_server.py

Make AsyncLLMEngine more robust & fix batched abort (#969 )

2023-09-07 13:43:45 -07:00

test_async_llm_engine.py

Remove AsyncLLMEngine busy loop, shield background task (#1059 )

2023-09-17 00:29:08 -07:00

test_request_tracker.py

Remove AsyncLLMEngine busy loop, shield background task (#1059 )

2023-09-17 00:29:08 -07:00