ATNLP: Week 3
The first tutorial will happen next week (Week 4), but you can already take a glance at the tutorial after Lecture 8, as by then the material needed to answer the tutorial questions will be covered, see under Tutorials. First lab session happens this week, see under Labs.
| Slides | Lecture | Course Content |
| Here | 7 - Evaluation | Required reading: Phan et al. (2025) Humanity's Last Exam Chiang et al. (2024) Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference |
| Here | 8 - Parameter Efficient Finetuning | Required reading: Hu et al. (2021), LoRA: Low-Rank Adaptation of Large Language Models, sections 1-4 Optional reading: Han et al. (2024), Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey, (This paper contains much more material than what we cover, and can be skimmed through.) |
| Here | 9 - Guest lecture (Edoardo Ponti) | Dynamic Sparsity in NLP: from Sparse Mixtures of Experts to Sparse Attention |
License
All rights reserved The University of Edinburgh