wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-09 18:05:19 +08:00
Code Issues Packages Projects Releases Wiki Activity
604 Commits 1 Branch 0 Tags
bd29cf3d3ad3dd06105f1a4bb9023bb23bdfd5ed
Commit Graph

3 Commits

Author SHA1 Message Date
wbn dacaf5a400 Replace head_mapping params with num_kv_heads to attention kernel. (#1997) 
Co-authored-by: wangguoya <wangguoya@baidu.com>
Co-authored-by: Yang Zhao <zhaoyangstar@foxmail.com>
 2023-12-10 10:12:53 -08:00
Yanming W e0c6f556e8 [Build] Avoid building too many extensions (#1624) 2023-11-23 16:31:19 -08:00
Woosuk Kwon 928de46888 Implement PagedAttention V2 (#1348) 2023-10-16 00:59:57 -07:00