NLU-11: Course Materials

This page contains links to each week of course content. At 7pm on the Friday before the week starts, the page for the following week will appear. This page will contain all the necessary instructions and information about the week and the course content: readings, slides for the lectures, tutorials, labs or assignments released. 

Lecture Recordings

All lecture recordings should be accessed via Learn; you will need to log in using your EASE account. (Learn provides you with access to any lecture recordings available for this course. You will need to select the "lecture recording" link once, before you can access any direct links to a lecture recording.)

Schedule 

For each week, the link will start working on the previous Friday evening. There might still be changes in the schedule for weeks that are currently in the future. 

• Week 1: Introduction, machine translation, and conditional language models.
• Week 2: Feedforward language models, recurrent neural networks, preprocessing and vocabulary
• Week 3: Sequence-to-sequence models with attention, transformers and pretrained language models
• Week 4: Decoding, neural parsing, and unsupervised parsing
• Week 5: Scaling laws, automata, and safety
• Week 6: RLHF, summarisation and parameter efficient fine tuning
• Week 7: Evaluation of generation and translation, multilingual translation models, translation and LLMs
• Week 8: Ethics, bias, and in context learning
• Week 9: Question answering, retrieval augmented generation, guest lecture on fact checking
• Week 10: Two guest lectures on diffusion models and movie summarisation, and an exam prep lecture 

Exam Guide

An exam guide is here.