Scribd
Upload
8 views

What Is NLP

Uploaded by

chessyrohan
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
8 views

What Is NLP

Uploaded by

chessyrohan
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 3

What is NLP?

Natural Language Processing (NLP) refers to the branch of Artificial Intelligence that allows machines to

understand human language.

Advantages

1. Quick Information Retrieval: Users can ask questions on any topic and get immediate,
precise answers.
2. Efficient Communication: NLP allows computers to communicate with humans in
natural languages.
3. Time Efficiency: It saves time in processing large amounts of information.
4. Enhanced Documentation: Many companies use NLP to improve documentation
processes, accuracy, and information retrieval from extensive databases.

Disadvantages

1. Contextual Limitations: NLP may struggle to understand context fully, leading to


potential misunderstandings.
2. Unpredictability: NLP outputs can sometimes be unreliable or unexpected.
3. High Input Demand: It may require additional keystrokes for accurate input.
4. Limited Adaptability: NLP is often task-specific and may not perform well outside its
designed domain

The components of Natural Language Processing (NLP) in the provided document are:

1. Natural Language Understanding (NLU): Helps machines understand and analyze


human language by extracting metadata such as concepts, entities, keywords, emotions,
relations, and semantic roles. It is used primarily in applications like understanding
customer issues from spoken and written language.
2. Natural Language Generation (NLG): Acts as a translator, converting structured data
into natural language. It includes text planning, sentence planning, and text realization,
facilitating human-computer communication by generating human-like responses or
narratives from data
The applications of NLP mentioned in your file are:

1. Question Answering
2. Spam Detection
3. Sentiment Analysis
4. Machine Translation
5. Spelling Correction
6. Speech Recognition
7. Chatbot
8. Information Extraction
9. Natural Language Understanding (NLU)

Here are the steps to build an NLP pipeline along with examples based on the provided file:

1. Sentence Segmentation: Break down text into individual sentences.


Example: "Independence Day is an important festival. It’s celebrated every year on
March 26."
2. Word Tokenization: Split sentences into individual words or tokens.
Example: "Copenhagen is the capital" → ["Copenhagen", "is", "the", "capital"]
3. Stemming: Reduce words to their root forms, even if not a real word.
Example: "celebrated", "celebrating" → "celebrat"
4. Lemmatization: Reduce words to their base form, preserving meaning.
Example: "intelligence", "intelligent" → "intelligent"
5. Identifying Stop Words: Remove common words like "is" and "the".
Example: "He is a good boy" → ["He", "good", "boy"]
6. Dependency Parsing: Identify relationships between words.
Example: "Google something on the Internet" (Google as a verb)
7. POS (Parts of Speech) Tagging: Identify grammatical roles of words.
Example: "Google something" (Google is tagged as a verb)
8. Named Entity Recognition (NER): Detect names of people, places, etc.
Example: "Steve Jobs introduced iPhone in San Francisco"
9. Chunking: Group words into larger units.
Example: "Manhattan calls out to Dave" → [“Manhattan calls”] (as one unit)

The challenges of NLP stem from ambiguity and uncertainty in language. There are three main
types of ambiguity:

1. Lexical Ambiguity: Occurs when a word has multiple meanings (e.g., "match" could
mean a sports game or a romantic partner).
2. Syntactic Ambiguity: Arises when a sentence can be parsed in more than one way (e.g.,
"I saw the girl with the binocular," where it’s unclear who has the binoculars).
3. Referential Ambiguity: Happens when a pronoun could refer to more than one entity
(e.g., "She said, 'I am hungry,'" where it’s unclear who "she" is)

Here are the five phases of NLP, along with brief descriptions and examples:

1. Lexical Analysis and Morphological Analysis:


o This phase breaks down text into paragraphs, sentences, and words, analyzing
word structure to identify lexemes (units of meaning).
o Example: The sentence "Cats are animals" would be divided into individual
lexemes: "Cats," "are," "animals."
2. Syntactic Analysis (Parsing):
o It checks grammar and word arrangements to understand relationships and if
sentences are meaningful.
o Example: In "He goes to the market," syntactic analysis confirms correct
structure, while "Market he goes" would be flagged as incorrect.
3. Semantic Analysis:
o Focuses on the literal meaning of words and phrases, ensuring the sentence makes
sense.
o Example: "John eats mango" is semantically correct, while "Mango eats John"
fails due to incorrect meaning.
4. Discourse Integration:
o Considers preceding and following sentences to interpret meaning.
o Example: In "She walked to the park. She enjoyed the scenery," discourse
integration helps understand that "She" refers to the same person in both
sentences.
5. Pragmatic Analysis:
o Examines the intended effect or context, beyond literal meaning.
o Example: "Could you open the window?" is pragmatically understood as a request
rather than a question about capability.

You might also like