wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-05 14:28:46 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,273 Commits 1 Branch 0 Tags
ffc0f2b47add6e0f70e2b5d4b4aaac64ee97f8ad
Commit Graph

3 Commits

Author SHA1 Message Date
sroy745 a78dd3303e [Encoder Decoder] Add flash_attn kernel support for encoder-decoder models (#9559) 2024-11-01 23:22:49 -07:00
wangshuai09 3ddbe25502 [Hardware][CPU] using current_platform.is_cpu (#9536) 2024-10-22 00:50:43 -07:00
sroy745 1009e93c5d [Encoder decoder] Add cuda graph support during decoding for encoder-decoder models (#7631) 2024-09-17 07:35:01 -07:00