vllm/tests/prefix_caching at 1d65ec7eeb35f03eb87ed080094f1aa5ff2ae3d3 - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-15 11:28:07 +08:00

Files

T

History

zifeitongandGitHub 47db6ec831 [Frontend] Add per-request number of cached token stats (#10174 )

2024-11-12 16:42:28 +00:00

..

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425 )

2024-05-13 23:50:09 +09:00

test_disable_sliding_window.py

[MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510 )

2024-10-18 14:30:55 -07:00

test_prefix_caching.py

[Frontend] Add per-request number of cached token stats (#10174 )

2024-11-12 16:42:28 +00:00