FNLP: Week 6
Tasks
Your major tasks and deadlines this week are:
- Attend lectures 16, 17, and 18.
- Work on and attend Tutorial 3.
- Read the readings for this week.
- Post a question on Piazza
- Ask a questions at the lectures and/or
- Ask your tutor
Lectures
| No | Date | Title |
| Lecture 16 | February 25 | The Transformer Model (Part 1) [slides] |
| Lecture 17 | February 26 | The Transformer Model (Part 2) [slides] [quiz for 2 lectures] |
| Lecture 18 | February 28 | Transfer Learning I (BERT) [slides] [quiz] |
Readings
| Jurafsky and Martin, 3rd edition | Chapter 9 (for lecture 16 and 17) | |
Jurafsky and Martin, 3rd edition | Chapter 10 | required |
| Jurafsky and Martin, 3rd edition | Chapter 11 | required |
| Devlin et al. (NAACL, 2019) | BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding | required |
| Lena Voita's course on Transformers and Transfer Learning | Available here | recommended |
| Jay Alammar's Ilustrated Transformer | Available here | recommended |
License
All rights reserved The University of Edinburgh