wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-04 21:23:13 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
0f4b32199ec6c5d16bc03767e36fff2d54559ff8
vllm/tests/kernels
T
History
Siyuan (Ryans) Zhuang e3cec88aa5 Memcpy kernel for flash attention (#29) 
* optimize

* add benchmark

* add assert

* add test
2023-04-10 18:22:49 -07:00
..
activation.py
Optimize data movement (#20)
2023-04-02 00:30:17 -07:00
attention.py
Support block size 32 (#35)
2023-04-09 23:07:18 -07:00
cache.py
Memcpy kernel for flash attention (#29)
2023-04-10 18:22:49 -07:00
layernorm.py
Add custom kernel for RMS normalization (#16)
2023-04-01 00:51:22 +08:00
pos_encoding.py
Optimize data movement (#20)
2023-04-02 00:30:17 -07:00