S2 Week 5 - Ethical and legal issues in supervised learning & Software engineering for data science
Monday's Lecture
We'll have a project Q&A and then we'll look at a case study that brings together Logistic Regression and legal and ethical issues of fairness in supervised learning.
- Slides
- Article about the case study on the UoE website: Equality law can disadvantage women in algorithmic credit decisions
- Andreeva, G. and Matuszyk, A. (2019), The law of equal opportunities or unintended consequences?: The effect of unisex risk assessment in consumer credit. J. R. Stat. Soc. A, 182: 1287-1311. https://doi.org/10.1111/rssa.12494Monday's and Wednesday's Lectures
Wednesday's Lecture
Wednesday's lecture is on the topic of software engineering for data science.
In 2023/24 it was given by Anna Hadjitofi, who has worked as a data scientist at the Turning Institute and Microsoft Research. Anna's lecture slides are still available.
Task
Preparation for the S2 Week 6 Workshop on inferential statistics exercises.
Lab
This week's lab is on web scraping, which was covered earlier in the course. As is the way with web scraping, the site that we scraped is now no longer in the same format, so some examples in the original lab don't work. There are still some useful nuggets there, including on how to do web scraping ethically and on the BeautifulSoup package. We'll try to fix the lab, but it may not happen quickly.