CSSE 313: Day 23

Outline

• From Transformers to LLMs
• Discussion of Attention paper
• Brief presentation of Nobel Prize in Chemistry and AlphaFold

Resources

• Slides for LLMs
• Slides for Attention paper
• Attention is all you need paper
• Slides for 2024 Chemistry Nobel
• 2024 Chemistry Nobel Prize science backgroup
• 2024 Chemistry Nobel Prize popular explanation

Assignments

• Day 33, 23:59: Fine-tuning Llama assignment.