DCA comment

2026-09-11 12:00:24 +08:00 · 2021-04-06 16:24:50 +02:00
parent b86e7fb2e8
commit 44b4cb5ba5
1 changed files with 1 additions and 0 deletions
@@ -354,6 +354,7 @@ class MonotonicDynamicConvolutionAttention(nn.Module):
        Dynamic convolution attention is an alternation of the location senstive attention with
    dynamically computed convolution filters from the previous attention scores and a set of
    constraints to keep the attention alignment diagonal.
+        DCA is sensitive to mixed precision training and might cause instable training.

    Args:
        query_dim (int): number of channels in the query tensor.