vllm/tests/kernels at a490aafa3671da1b6b2be6cff4568913fcb1732c - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-01 23:34:49 +08:00

Files

T

History

Siyuan (Ryans) Zhuang 21b3671bbc Basic attention kernel that supports cached KV + (multi-)prompts (#24 )

2023-04-04 20:34:46 -07:00

..

activation.py

Optimize data movement (#20 )

2023-04-02 00:30:17 -07:00

attention.py

Basic attention kernel that supports cached KV + (multi-)prompts (#24 )

2023-04-04 20:34:46 -07:00

cache.py

Optimize data movement (#20 )

2023-04-02 00:30:17 -07:00

layernorm.py

Add custom kernel for RMS normalization (#16 )

2023-04-01 00:51:22 +08:00

pos_encoding.py

Optimize data movement (#20 )

2023-04-02 00:30:17 -07:00