Skip to main content

NLU-11 - top navigation

  • Learn
  • Piazza
  • DRPS

Breadcrumb

  1. Home
  2. NLU-11: Natural Language Understanding, Generation, and Machine Translation
  3. NLU-11: Course Materials

NLU-11: Week 1

The NLU+ course consists of three live lectures a week which are also live streamed and recorded for those who are unable to attend in person. To view lectures go to Learn Ultra and click on the Lecture Recordings link.

In all cases the lecture content and the required reading are examinable, the background reading is not.

SlidesLectureCourse Content
  • Introduction
  • [no overlays]
1 (All)

Required reading:

The Future of Computational Linguistics: Beyond the Alchemy Church and Lieberman (21)
 

  • Machine Translation
  • Handout: Translation Exercise
2 (Birch)

Background reading:

Automating Knowledge Acquisition for Machine Translation, Knight.

  • Conditional Language Models (with n-grams)
  • [no overlays]
3 (Birch)
 

Required reading:

Word Alignment and the Expectation Maximization Algorithm, Lopez.

Alternative to required reading: A tutorial MT workbook, Knight. Gives a different view of similar material. Contains exercises, so helpful if you want to revise some basic ideas about probability.

Background reading:

  • Revision, in case you need to brush up on your probability: Basic probability theory, Goldwater.
  • Revision, in case you want to brush up on n-gram language models: Neural Machine Translation and Sequence-to-sequence Models: A Tutorial, Neubig. Read up through the end of Section 3; the rest of the material will be covered in later lectures.

There are now many introductions to the basics of neural networks for NLP, which we'll focus on during the first few weeks of the course. What matters is that you understand the underlying concepts, rather than a particular author's notation. Everyone learns differently, so if you prefer a different take on perceptrons, feedforward models, recurrent networks, or attention, you may want to consult some of these resources in addition to (or as alternative to) the required readings:

  • Speech and Language Processing (3rd edition draft), Jurafsky & Martin.
  • Natural Language Processing, Eisenstein.
  • Deep Learning, Goodfellow et al. 
Files
cenaturiarcturanworksheet.pdf (30.8 KB)
l01-introduction-handout.pdf (1.43 MB)
l01-introduction.pdf (1.49 MB)
l02-translation.pdf (4.1 MB)
l03-conditional-lm-handout.pdf (594.93 KB)
l03-conditional-lm.pdf (684.67 KB)
License
All rights reserved The University of Edinburgh

Book traversal links for NLU-11: Week 1

  • NLU-11: Course Materials
  • Up
  • NLU-11: Week 2

Navigation links

  • NLU-11: Schedule
  • NLU-11: Tutorials
  • NLU-11: Resource List
  • NLU-11: Course Materials
    • NLU-11: Week 1
    • NLU-11: Week 2
    • NLU-11: Week 3
    • NLU-11: Week 4
    • NLU-11: Week 5
    • NLU-11: Week 6
    • NLU-11: Week 7
    • NLU-11: Week 8
    • NLU-11: Week 9
    • NLU-11: Week 10
  • NLU-11: Labs (Demo Sessions)
  • NLU-11: Assessment
RSS feed

Opencourse privacy & accessibility statements; contact Informatics, ILTS.