FNLP: Week 6
Tasks
Your major tasks and deadlines this week are:
- Attend lectures 16, 17, and 18.
- Read the readings for this week.
- Review the solution to lab 2 after attempting it yourself.
- Work on tutorial sheet 3 and attend your timetabled tutorial.
- Post a question on Piazza
- Ask a questions at the lectures and/or
- Attend the drop in help hour (Wednesday at 4 in AT 2.07)
- Get started on the coursework, to be released on Thursday the 26th.
Lectures
| No | Date | Title |
| Lecture 16 | February 24 | The Transformer Model, Part 1: Multi-Head Self-Attention [slides] [quiz] |
| Lecture 17 | February 25 | The Transformer Model, Part 2: Architecture [slides] [quiz] |
| Lecture 18 | February 27 | The Transformer Model, Part 3: Input and Output [slides] [quiz] |
Readings
| Jurafsky and Martin, 3rd edition | Chapter 8, through 8.7 | required |
| Lena Voita's course on Sequence to Sequence (seq2seq) and Attention | Available here | recommended |
| Jay Alammar's Ilustrated Transformer | Available here | recommended |
Lab 2 Solution
Tutorial 3
Coursework
Now available on Learn
License
All rights reserved The University of Edinburgh