wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-06-28 03:36:08 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,266 Commits 1 Branch 0 Tags
235366fe2eb3144321978e181af94487f0215595
Commit Graph

3 Commits

Author SHA1 Message Date
sroy745 a78dd3303e [Encoder Decoder] Add flash_attn kernel support for encoder-decoder models (#9559) 2024-11-01 23:22:49 -07:00
wangshuai09 3ddbe25502 [Hardware][CPU] using current_platform.is_cpu (#9536) 2024-10-22 00:50:43 -07:00
sroy745 1009e93c5d [Encoder decoder] Add cuda graph support during decoding for encoder-decoder models (#7631) 2024-09-17 07:35:01 -07:00