FNLP: Week 7
Tasks
Your major tasks and deadlines this week are:
- Attend lectures 19, 20, and 21.
- Read the readings for this week.
- Attend Lab 3.
- Start looking at questions for Tutorial 3.
- Post a question on Piazza
- Ask a questions at the lectures and/or
- Ask your tutor
Lectures
| No | Date | Title |
| Lecture 19 | March 4 | Transfer Learning II (T5, GPT) [lecture] [quiz] |
| Lecture 20 | March 5 | Prompting and In-context Learning [lecture] [quiz] |
| Lecture 21 | March 7 | Scaling Laws and Instruction Tuning [lecture] [quiz] |
Readings
Jurafsky and Martin, 3rd edition | Chapter 10, Sections 10.1-10.3 Chapter 12, Sections 12.1-12.3 | required |
| Radford et al. (2018) | Improving Language Understanding by Generative Pre-Training | required |
| Brown et al. (2020) | Language Models are Few-shot learners | required |
| Kaplan et al (2020) | Scaling Laws for Neural Language Models | recommended |
License
All rights reserved The University of Edinburgh