vllm/benchmarks/kernels at 2709c0009aa434fbf2ef0fe48ca3094a2268b190 - vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-12 23:30:54 +08:00

Files

T

wbn dacaf5a400 Replace head_mapping params with num_kv_heads to attention kernel. (#1997 )

Co-authored-by: wangguoya <wangguoya@baidu.com>
Co-authored-by: Yang Zhao <zhaoyangstar@foxmail.com>

2023-12-10 10:12:53 -08:00

benchmark_paged_attention.py

2023-12-10 10:12:53 -08:00