This page introduces you to annotating corpora, and using the annotation to evaluate NLP methods. It contains:
- lectures slides
- some required reading from Jurafsky and Martin
- a quiz that tests your understanding of the material presented here (soon to appear).
Please do the required reading, and attempt the quiz. If there is anything you don't understand, then please ask questions in the lecture or on piazza.
Slides and required reading
Additional (non-essential) reading on significance testing:
Learning Linguistic Structure, Noah Smith, Appendix B. The link to PDF of the book should work when accessing through the university network / VPN)
Quiz 4: Annotation and Evaluation
These questions are designed to test your understanding of the above course content; doing this quiz does not contribute to your overall grade. Some questions require a text answer. You can ask for formative feedback on these from your tutor or on piazza. Other questions are multiple choice or they require a numeric answer: you will get immediate feedback for these. Please don't attempt this quiz until you have acquainted yourself with this lecture and the required reading.
You must be logged onto Learn to do this quiz.