Textbook of AI

Abstract. Introduces the attention mechanism for neural machine translation, allowing the decoder to compute a weighted combination of encoder states at each step rather than relying on a single fixed context vector. Attention dramatically improved translation quality on long sentences.