Skip to main content

FNLP - top navigation

  • Learn
  • Piazza
  • DRPS

Breadcrumb

  1. Home
  2. FNLP: Foundations of Natural Language Processing
  3. FNLP: Course Materials
  4. FNLP: Week 5: POS Tagging, Context Free Grammars and Parsing

FNLP: 13: POS tagging (part 2: Viterbi, Forward algorithm)

In the previous lecture, we discussed tagging problems, especially the part-of-speech tagging tasks, and introduced the classic model for this class of problems, the Hidden Markov Model (HMMs).  In the 13th lecture, we continue with POS tagging and HMM, and, after a short recap, introduce the classic dynamic programming algorithm for tagging with HMMs ( Viterbi algorithm for HMMs). We also discuss how the algorithm can be easily modified so that it computes the probability of a sequence of words, i.e. explain how HMM can be used as a language model. We also provide an intuition for how HMMs can be estimated in an unsupervised way (i.e. the forward-backward algorithm), though we will not describe in detail.
 
Please do the required reading and attempt the quiz.
If there is anything you don't understand, then please ask questions in the lecture or on piazza.

Slides and required reading

Slides

Reading: Sections 6.1-6.4 in Jurafsky & Martin (2nd edition). 

Quiz 13: PoS tagging / algorithms

These questions are designed to test your understanding of the above course content; doing this quiz does not contribute to your overall grade.  Some questions require a text answer.  You can ask for formative feedback on these from your tutor or on piazza.  Other questions are multiple choice or they require a numeric answer: you will get immediate feedback for these. Please don't attempt this quiz until you have acquainted yourself with this lecture and the required reading.

You must be logged onto Learn to do this quiz.

License
All rights reserved The University of Edinburgh

Book traversal links for FNLP: 13: POS tagging (part 2: Viterbi, Forward algorithm)

  • FNLP: Week 5: POS Tagging, Context Free Grammars and Parsing
  • Up
  • FNLP: 14: Introduction to Syntax and Syntactic Parsing

Navigation links

  • FNLP: Resource List
  • FNLP: Assessment
  • FNLP: Course Materials
    • FNLP: Week 1: Overview, Ambiguity and Corpora
    • FNLP: Week 2: Annotation, Evaluation and Language Models
    • FNLP: Week 3: Important ML techniques for NLP
    • FNLP: Week 4: More ML methods, Morphology and POS tagging
    • FNLP: Week 5: POS Tagging, Context Free Grammars and Parsing
      • FNLP: 13: POS tagging (part 2: Viterbi, Forward algorithm)
      • FNLP: 14: Introduction to Syntax and Syntactic Parsing
      • FNLP: 15: Probabilistic Context-Free Grammars and Statistical Parsing
    • FNLP: Week 6: More Parsing and Compositional Semantics
    • FNLP: Week 7: Discourse Semantics and Lexical Semantics
    • FNLP: Week 8: Deep Learning for NLP
    • FNLP: Week 9: Neural Text Generation
    • FNLP Week 10: Transfer learning, Revision and Q&A
  • FNLP: Lab Exercises
  • FNLP: Tutorial Exercises
RSS feed

Opencourse privacy & accessibility statements; contact Informatics, ILTS.