CSEP 517 - Natural Language Processing (original) (raw)

Week

Dates

Topics & Lecture Slides

Notes (Required)

Textbook & Recommended Reading

1

Jan 9

Introduction [slides]
Language Models (LMs) [slides]

LM

JM 4.1-4; MS 6

2

Jan 16

Hidden Markov Models (HMMs) [slides]

HMM

JM 4.5-7; MS 6; JM 5.1-5.3; 6.1-6.5; MS 9, 10.1-10.3

3

Jan 23

Probabilistic Context Free Grammars (PCFGs) [slides]

PCFG

4

Jan 30

Log-Linear Models [slides]; Linear Seqence Models [slides]

LogLinear

Inside-outside

5

Feb 6

Word Embeddings [slides]; Neural Networks [slides]

Feed Forward NNs

JMv3 Vector Semantics,

6

Feb 13

Recurrent Neural Networks (RNNs) [slides]

JM Chapter 9

7

Feb 20

Machine Translation (MT) [slides]; Neural MT [slides]

IBM Models 1 and 2, Phrase MT

Neural MT

8

Feb 27

Contextualized Embeddings: ELMo, BERT, etc. [slides]

9

Mar 5

Frame Semantics [slides]; Coreference Resolution [slides]

Frame Semantics

JM 19.4; JM 20.7

10

Mar 12

Question Answering; Langauge Grounding

JM 25; MS 13