ATNLP: Week 4

First tutorial happening this week! See under "Tutorials". Solutions for labs released. See under "Labs".

SlidesLectureReading materials
Here10 - Distillation

Xu et al. (2024); A Survey on Knowledge Distillation of Large Language Models Section 1 and Section 3 (skim both)

Here11 - Long context modellingPeng et al (2023) YaRN: Efficient Context Window Extension of Large Language Models Section 1-4
Here12 - Guest lecture (Ivan Titov)  
License
All rights reserved The University of Edinburgh