ATNLP: Course Materials
This page contains links to each week of course content. At 7pm on the Friday before the week starts, the page for the following week will appear. This page will contain all the necessary instructions and information about the week and the course content: readings, slides for the lectures, tutorials, labs or assignments released.
Lecture Recordings
All lecture recordings should be accessed via Learn; you will need to log in using your EASE account. (Learn provides you with access to any lecture recordings available for this course. You will need to select the "lecture recording" link once, before you can access any direct links to a lecture recording.)
Schedule
For each week, the link will start working on the previous Friday evening. There might still be changes in the schedule for weeks that are currently in the future. We divided the topics into "Introductory", "Applications", "Core topics", "Insight and Linguistics" and "Safety and Ethics". See also disclaimer in the main page.
- Week 1: Introduction, machine translation, and summarisation.
- Week 2: Question answering, synthetic data. Guest lecture: LLMs and speech models in Uganda
- Week 3: Evaluation, parameter-efficient finetuning. Guest lecture: Sparsity in LLMs
- Week 4: Distillation, long-context modelling. Guest lecture: TBC
- Week 5: Reasoning, retrieval augmented generation. Guest lecture: TBC
- Week 6: Mechanistic interpretability, LLMs as formal machines. Guest lecture: Diffusion models for NLP
- Week 7: Syntax and parsing, safety and security. Guest lecture: Explainability
- Week 8: Ethics, multilingual LLMs. Guest lecture: Fact checking
- Week 9: Multimodal models. Guest lecture: TBC
- Week 10: Agents, retrospective, exam prep
Exam Guide
An exam guide will be added closer to the exam.