Week-by-Week Course Overview
Legend: L lecture, A assignment (coursework), T tutorial, D lab (demo session)
Date | Lecture No | Alternative lecture syllabus | Lecturer | Tutorials/labs | Assignments |
Week 1 15 Jan | L01 | Introduction | All | none | |
L02 | Machine Translation | Birch | |||
L03 | Conditional Language Models | Birch | |||
Week 2 22 Jan | L04 | Feedforward Language Models | Birch | A01 issued - Monday 22 January A01 partner choice due | |
L05 | Recurrent Neural Networks | Birch | |||
L06 | Datasets and Vocabulary | Birch | |||
Week 3 29 Jan | L07 | Sequence-to-sequence Models with Attention | Cohen | D01: Numpy | |
L08 | Transformers | Cohen | |||
L09 | Word Embeddings | Cohen | |||
Week 4 5 Feb | L10 | Pretrained Langauge Models | Cohen | T01: Neural Language Models | |
L11 | Prompting | Cohen | |||
L12 | Decoding | Cohen | |||
Week 5 12 Feb | L13 | Neural Parsing | Cohen | D02: Distributed Representations | |
L14 | Scaling laws in LLMs | Cohen | |||
L15 | Security/safety in LLMs | Cohen | A01 due - Friday 16 February | ||
19 Feb | - | Flexible Learning Week: no teaching | |||
Week 6 26 Feb | L16 | Evaluating Translation and Generation | Birch | T02: Transformers | |
L17 | Machine Translation with Multilingual Data | Birch | |||
L18 | Question Answering | Minervini | A02 issued - Friday 1 March | ||
Week 7 4 Mar | L19 | Ethics in NLP | Birch | D03: Tensor Computation in PyTorch | A02 - partner choice due - Monday 4 March |
L20 | Bias in Word Embeddings | Birch | |||
L21 | LLMs, Alignment, and Evaluation | Minervini | |||
Week 8 11 Mar | L22 | Translation and LLMs | Birch | T03: Ethics and NLP | |
L23 | Retrieval Augmented Models | Minervini | |||
L24 | Generation, In-context Learning, and Reasoning | Minervini | |||
Week 9 18 Mar | L25 | Movie Summarisation | Frank Keller | D04: Prompting with GPT-3.5 | |
L26 | Summarisation | Minervini | |||
L27 | Parameter Efficient Fine-Tuning | Minervini | A02 due - Friday 22 March | ||
Week 10 25 Mar | L28 | Spoken Language Translation | TszKin Lam | T04: Summarization | |
L29 | Unsupervised Parsing | Minervini | |||
L30 | Exam Review | All |