This week we have our last lecture on translation.
There will a tutorial on ethics this week. Please prepare answers to the followoing questions before your tutorial group meets:
As a reminder, Coursework 2 has been issued and is due on Friday 22 March at 12:00 noon.
Also, the lab for next week has been released. This is a lab on prompting with GPT-3.5. It even includes a small competition on who can develop the best performing prompt on a small data set! Please note you will need an OpenAI key to run this lab; please obtain this before you attend your lab session, instructions can be found in the lab itself.
Finally, the solutions for last week's lab on tensor computation and PyTorch are now available:
Solutions for Lab 3, Colab version
| Slides | Lecture | Course Content |
| Translation and LLMs | 22 (Birch) | Optional Reading:
|
| Retrieval-Augmented Generation | 23 (Minervini) | Required Reading: Reliable, Adaptable, and Attributable Language Models with Retrieval, https://arxiv.org/abs/2403.03187 ATLAS: Few-shot Learning with Retrieval Augmented Language Models, https://arxiv.org/abs/2208.03299 Optional Reading: REALM: Retrieval-Augmented Language Model Pre-Training, https://arxiv.org/abs/2002.08909 Reading Wikipedia to Answer Open-Domain Questions, https://arxiv.org/abs/1704.00051 Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets, https://arxiv.org/abs/2008.02637 Challenges in Generalisation in Open Domain Question Answering, https://arxiv.org/abs/2109.01156 |
| Generation, In-context Learning, and Reasoning | 24 (Minervini) |