CSSE 313: Day 22

Outline

• Long-short term memory networks (LSTM)
• Attention

Resources

• Slides on LSTMs and Attention
• Visualizing memorization in RNNs

Resources

• Day 29, BC: Summarize the article Attention is all you need and submit it to the appropriate drop-box on Moodle. When it comes to the length, 300 words seems to work well. We will discuss this article in class.