4 Commits

Author	SHA1	Message	Date
sroy745	b41fb9d3b1	[Encoder Decoder] Update Mllama to run with both FlashAttention and XFormers (#9982) ... Signed-off-by: Sourashis Roy <sroy@roblox.com>	2024-11-12 10:53:57 -08:00
sroy745	a78dd3303e	[Encoder Decoder] Add flash_attn kernel support for encoder-decoder models (#9559)	2024-11-01 23:22:49 -07:00
wangshuai09	3ddbe25502	[Hardware][CPU] using current_platform.is_cpu (#9536)	2024-10-22 00:50:43 -07:00
sroy745	1009e93c5d	[Encoder decoder] Add cuda graph support during decoding for encoder-decoder models (#7631)	2024-09-17 07:35:01 -07:00