🗓️ Week 04 - Intro to tranformers

👨‍🏫 Lecture Slides

Either click on the slide area below or click here to view it in fullscreen. Use your keypad to navigate the slides.

✍️ Homework

• Reading
  • Read the first 5 pages of Attention is All You Need paper.
  • Read about Self-attention mechanism here: https://jalammar.github.io/illustrated-transformer/
  • Watch these videos:
    • https://www.youtube.com/watch?v=wjZofJX0v4M
    • https://www.youtube.com/watch?v=eMlx5fFNoYc