COV884: Advanced Topics in NLP
Wednesday 4-5:30 pm, Friday 11:30 am-1 pm on Microsoft Teams

Instructor: Mausam
(mausam at cse dot iitd dot ac dot in)
Office hours: by appointment, SIT Building Room 402 		TA: Keshav Kolluru
(keshavkolluru at gmail dot com)
Office hours: by appointment

Course Contents

Information Extraction, Question Answering, Dialog Systems, Pre-trained Language Models, Bias in NLP.

Schedule

    Information Systems

  1. Topic: Chitchat in Task-Oriented Dialog
    Reading: Adding Chit-Chat to Enhance Task-Oriented Dialogues.
    [Slides]

  2. Topic: Persona-based Dialog
    Reading: Personalizing Dialogue Agents: I have a dog, do you have pets too?.
    [Slides]

  3. Topic: NLU over Semi-Structured Data
    TAPAS: Weakly Supervised Table Parsing via Pre-training.
    [Slides]

  4. Topic: Knowledge-graph based Question Answering
    QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering.
    [Slides]


    5. Machine Learning in NLP

  5. Topic: Style Transfer
    Stable Style Transformer: Delete and Generate Approach with Encoder-Decoder for Text Style Transfer.
    [Slides]

  6. Topic: Knowledge Distillation
    Lifelong Language Knowledge Distillation.
    [Slides]

  7. Topic: Multilingual Transformers
    mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer.
    [Slides]

  8. Topic: Multimodal Transformers
    Perceiver IO: A General Architecture for Structured Inputs & Outputs .
    [Slides]


    9. Other Topics in NLP

  9. Topic: Bias in NLP
    Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systems.
    [Slides]

  10. Topic: Evaluation Metrics for Generation
    BERTScore: Evaluating Text Generation with BERT.
    [Slides]


Grading

Presentation: 45%; Reviews: 45%; Participation: 10%.