Natural Language Processing
Natural Language Processing
CSE4022
1 NLP - Introduction
2 Levels/Stage of NLP
5 Project Component
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 1 / 29
NLP - Intro
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 2 / 29
Real Life Applications of NLP
NLP - Applications
Google Language Translation
Grammar and Spelling correction - Grammarly, Language tool
Information Retrieval - Google News, Semantic Scholar
Name Entity Recognition (NER) - Explostion AI NER
Parts of Speech Recognition (POS) - POS online tool
Sentence Autocomlete
Document Summarization
Sentiment Analysis
Question Answering
Chatbots - ILA: SBI oneline chatbot
Document Generations
Generating Images based on description- DALLE-2
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 3 / 29
NLP systems
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 4 / 29
NLP terminologies
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 6 / 29
Stages of NLP - Lexical Analysis
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 7 / 29
Stages of NLP - Syntactic Analysis
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 8 / 29
Stages of NLP - Semantic Analysis
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 9 / 29
Stages of NLP - Discourse Integration
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 10 / 29
Stages of NLP - Pragmatic Analysis
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 11 / 29
Ambiguities in NLP
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 12 / 29
Ambiguities in NLP (Contd.)
Different levels of Ambiguity
4 Discourse level ambiguity: where the interpretation is ambiguous by
the virtue of context (previous word/sentence/paragraph).
e.g.Referential Ambiguity.
Referential Ambiguity
Referring to something using pronouns. For example, Rima went to
Gauri. She said, “I am tired.” =⇒ Exactly who is tired? Solution:
Co-reference resolution. Referential ambiguity is also known as
Anaphoric Ambiguity.
5 Pragmatic level ambiguity: Pragmatic ambiguity refers to a situation
where the context of a phrase gives it multiple interpretation and it
require real world knowledge for correct interpretation.
One of the hardest tasks in NLP.
The problem involves processing user intention, sentiment, belief,
world, etc.- all of which are highly complex tasks.
Pragmatic Ambiguity occurs when context does not provide enough
information to clarify the statement.
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 13 / 29
Ambiguities in NLP (Contd.)
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 14 / 29
Ambiguities in NLP - Lexical Ambiguities
A word as different parts-of-speech (POS)
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 19 / 29
Challenges of NLP
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 19 / 29
Challenges of NLP
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 19 / 29
Challenges of NLP
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 19 / 29
Challenges of NLP
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 19 / 29
Challenges of NLP
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 19 / 29
Challenges of NLP
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 19 / 29
Challenges of NLP (Contd.)
1 Content of this slide is borrowed from Prof. Dan Jurafsky lecture slides
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 20 / 29
Real world Application of NLP
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 22 / 29
Heroes of NLP (Contd.)
3 Oren Etzioni, CEO of the Allen Institute for Artificial Intelligence.
introduced a tool called Semantic scholar which will summarize large
textual PDF files.
Professor at Emeritus, the University of Washington
Awarded as Seattle’s Geek of the Year (2013).
Xo-founded several companies, including Farecast (acquired by
Microsoft)
4 Quoc Le, Research Scientist at Google Brain
Initially worked on deep-learning based Image classification.
From 2014 onwards he has worked towards textcolorblueAutomating
Machine Learning (AutoML).
5 Prof. Dan Jurafsky - Professor of Computer Science and Linguistics
at Stanford University.
Recipient of the 2002 MacArthur Fellowship.
author of book titled “Speech and Language Processing: An
Introduction to Natural Language Processing, Computational
Linguistics, and Speech Recognition”.
developed first automated system for Semantic role labeling with
Daniel Gildea.
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 23 / 29
Heroes of NLP (Contd.)
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 24 / 29
Related Online Courses
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 25 / 29
Project Component
Google form for Title and Team finalization - Deadline next class
Review 1 – 15 marks (for satisfactory demonstration)
Review 2 – 25 marks (20 marks for satisfactory demo, +5 for
additional work)
Review 3 – 45 marks (40 marks for satisfactory demo, +5 for
additional work)
Submission of review or research paper – 15 marks (subject to
plagiarism report)
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 26 / 29
Summary Slides
What is NLP?
Stages of NLP
Dis-ambiguity in NLP
Challenges of NLP.
Models and Algorithm categories in NLP.
Real world Applications of NLP
Heroes of NLP and related online courses.
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 27 / 29
Next lectures
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 28 / 29
Dr. Durgesh Kumar Lecture-02 — NLP — CSE4022 July 28, 2022July 28, 2022 29 / 29