wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-04 13:24:17 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,340 Commits 1 Branch 0 Tags
925d2f19089b50736ce5e0f2ba0c9b7f3da6fb15
Commit Graph
4 Commits
Author SHA1 Message Date
sroy745andGitHub b41fb9d3b1 [Encoder Decoder] Update Mllama to run with both FlashAttention and XFormers (#9982) 
Signed-off-by: Sourashis Roy <sroy@roblox.com>
 2024-11-12 10:53:57 -08:00
sroy745andGitHub a78dd3303e [Encoder Decoder] Add flash_attn kernel support for encoder-decoder models (#9559) 2024-11-01 23:22:49 -07:00
wangshuai09andGitHub 3ddbe25502 [Hardware][CPU] using current_platform.is_cpu (#9536) 2024-10-22 00:50:43 -07:00
sroy745andGitHub 1009e93c5d [Encoder decoder] Add cuda graph support during decoding for encoder-decoder models (#7631) 2024-09-17 07:35:01 -07:00