Tag: NMT
-
LSTM Attention vs Self-Attention: How Bahdanau Evolved
Bahdanau's 2014 attention fixed seq2seq bottlenecks but kept sequential encoders. How three key problems led to self-attention and 3x speedups.
Bahdanau's 2014 attention fixed seq2seq bottlenecks but kept sequential encoders. How three key problems led to self-attention and 3x speedups.