wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-09 21:36:32 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
ee88a7e5f3acc1f81c52dfc45d2bdd542b4cd9ed
vllm/tests/kernels
T
History
Woosuk Kwon c267b1a02c Add query stride to multi_query_cached_kv_attention & Add kernel benchmark script (#27) 
* Add query stride to multi_query_cached_kv_attention

* Add kernel benchmark script
2023-04-08 13:36:09 -07:00
..
activation.py
Optimize data movement (#20)
2023-04-02 00:30:17 -07:00
attention.py
Add query stride to multi_query_cached_kv_attention & Add kernel benchmark script (#27)
2023-04-08 13:36:09 -07:00
cache.py
Implement block copy kernel to optimize beam search (#32)
2023-04-07 17:45:07 -07:00
layernorm.py
Add custom kernel for RMS normalization (#16)
2023-04-01 00:51:22 +08:00
pos_encoding.py
Optimize data movement (#20)
2023-04-02 00:30:17 -07:00