vllm/benchmarks/kernels at 81653d968842d2ec51b2642b6b5d83786271f9af - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-08-12 12:30:29 +08:00

Files

T

History

TerryandGitHub 7e9bd08f60 Add batched RoPE kernel (#3095 )

2024-03-13 13:45:26 -07:00

..

benchmark_mixtral_moe.py

Optimize Triton MoE Kernel (#2979 )

2024-02-26 13:48:56 -08:00

benchmark_paged_attention.py

Remove hardcoded device="cuda" to support more devices (#2503 )

2024-02-01 15:46:39 -08:00

benchmark_rope.py

Add batched RoPE kernel (#3095 )

2024-03-13 13:45:26 -07:00