vllm/tests/prefix_caching at e0dbdb013dfe5cdbe044317b4d7d55644d6399b3 - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-02 12:16:17 +08:00

Files

T

History

Cody Yu 3ac50b47d0 [MISC] Add prefix cache hit rate to metrics (#7606 )

2024-08-19 11:52:07 -07:00

..

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425 )

2024-05-13 23:50:09 +09:00

test_disable_sliding_window.py

[Bugfix / Core] Prefix Caching Guards (merged with main) (#4846 )

2024-05-27 15:18:17 -07:00

test_prefix_caching.py

[MISC] Add prefix cache hit rate to metrics (#7606 )

2024-08-19 11:52:07 -07:00