FNLP: Week 7
Tasks
Your major tasks and deadlines this week are:
- Attend lectures 19, 20, and 21.
- Read the readings for this week.
- Attend Lab 3.
- Post a question on Piazza
- Ask a questions at the lectures and/or
- Ask your tutor
Lectures
| No | Date | Title |
| Lecture 19 | March 3 | Transfer Learning (BERT) [lecture] [quiz] |
| Lecture 20 | March 4 | Prompting and In-context Learning [lecture] [quiz] |
| Lecture 21 | March 6 | Scaling Laws and Instruction Tuning [lecture] [quiz] |
Readings
Jurafsky and Martin, 3rd edition | Chapter 10 and Chapter 7 | required |
| Radford et al. (2018) | Improving Language Understanding by Generative Pre-Training | required |
| Brown et al. (2020) | Language Models are Few-shot learners | required |
| Kaplan et al (2020) | Scaling Laws for Neural Language Models | recommended |
Tutorial 3 Solutions
Lab 3
License
All rights reserved The University of Edinburgh