Week 9: Neural networks (cont), sentence semantics

Reminders and announcements

• Solutions to Tutorial 3 are now available.
• Tutorial 4 (for week 10) will give you practice answering real exam questions, from a previous year's exam. We recommend that you treat this as a practice exam: set a timer for 45 minutes, and write your answers on paper. The questions span material from the whole semester, and will test your knowledge of multiple topics.
  • If you haven't already, we recommend you read through the exam revision guide before attempting the tutorial questions. Note that each of the two tutorial questions was originally worth a total of 10 marks (out of 50) in an past exam.
• Reminder that there are extra help hours this week for the assignment - see the bottom of this page for times.

Overview of the week

Welcome to Week 9! As we near the end of the semester, it's always a difficult time of year. I expect that many of you (like us) are feeling the strain of working hard for so long, you probably have several coursework deadlines coming up, and of course the weather is colder and darker as well.

So, you will probably be glad to hear that the mandatory technical content will be one of the lighter ones this week. In the first two lectures, we'll cover some classic approaches to semantics and more recent contextualised word representations. In the third lecture, we'll host a guest lecture from Emile van Krieken, a postdoc in Edoardo's group, who will discuss the challenges with reasoning in language models.

Lectures and readings

Remaining help hours for assignment 2

All help hours are in AT 5.07.