Week 5: Algorithmic bias and RNNs
Reminders and announcements
Welcome to Week 5! I (Sharon) will be lecturing again for the next three weeks, and I'm looking forward to seeing many of you again and getting a chance to talk to some of you after each lecture.
There's no Additional Materials section this week, as all the materials are here!
- Solutions for Tutorial 1 : this link will go live after all groups have met (end of Week 4).
- Exercises for Tutorial 2 are linked again here for convenience. As usual, you should plan to work through the questions before your tutorial group meets this week.
- In week 6 and 7 we will have lab sessions, where you'll be able to work with RNNs (which I will cover this week) and Transformers (which I will cover next week).
Overview of this week
On Monday this week, we will continue to build up our repertoire of different models, this time introducing RNNs, which will finally allow us to relax the strict independence assumptions adopted by all the previous language models we've seen.
The Wed and Fri lectures will be a bit of a change. Instead of focusing on linguistic structure or computational methods, we'll have the first of a few lectures where we will discuss some of the ethical issues that arise when we start to use NLP systems in the real world. In this case, we will be talking about algorithmic bias: what it is, and some examples of where and how it can arise. To illustrate these ideas, I'll focus on an aspect of language that is often overlooked by NLP systems: how social identity and language interact in the use of dialects (or language varieties). Wednesday's lecture will provide some background on how linguists think about dialects, which might be different from how you think about them! Then I'll go into more detail with an early case study demonstrating bias in NLP systems against speakers of a particular dialect of English.
Lectures and readings
| Lecture # | Who? | Slides | Reading |
|---|---|---|---|
| 1 | SG | JM3 14.0-14.2 (*), 14.3.1-2, 14.3.3 (*), 14.7 (*)
| |
| 2 | SG | Dialect and discrimination | Understanding Bias, Part 1* from Machines Gone Wrong by Lim Swee Kiat. JM3 4.12 |
| 3 | SG | Dialect case study and additional data ethics | See the notes below about these additional readings: |
Notes about additional reading for Lecture 3:
- School Ethics page: you don't need to read the whole thing (!), just have a quick look at what's there, and read the "Ethics and Integrity" section which is a very brief overview.
- ACL Responsible NLP Guidelines: Again, you do not need to read the whole thing in detail. Look over the headings in bold, especially for parts B and D, and consider how these relate to issues we've discussed in this class.
- Luccioni and Viviano (2021): I will refer to this very briefly in the lecture, and it is not urgent to read it right now, but we will ask you to read it before Tutorial 3 group meetings, which will have some questions about the paper.