Scribd
Upload
65 views4 pages

Artificial Intelligence Assignment 6

This document outlines the six main phases of natural language processing: morphological analysis, lexical analysis, syntactic analysis, semantic analysis, discourse integration, and pragmatic analysis. It provides details on what each phase involves, such as morphological analysis examining the structure of words and lexical analysis dividing text into paragraphs and sentences. The document also gives examples to illustrate each analysis, such as semantic analysis assigning meanings to syntactic structures and pragmatic analysis interpreting language use in different situations.

Uploaded by

natasha ashlee
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
65 views4 pages

Artificial Intelligence Assignment 6

This document outlines the six main phases of natural language processing: morphological analysis, lexical analysis, syntactic analysis, semantic analysis, discourse integration, and pragmatic analysis. It provides details on what each phase involves, such as morphological analysis examining the structure of words and lexical analysis dividing text into paragraphs and sentences. The document also gives examples to illustrate each analysis, such as semantic analysis assigning meanings to syntactic structures and pragmatic analysis interpreting language use in different situations.

Uploaded by

natasha ashlee
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 4

Explain in detail all steps involved in natural language processing [30] marks

Natural Language Processing is a subfield of Artificial Intelligence and linguistic, devoted to


make computers understand the statements or words written in human languages. A Natural
language also known as ordinary language that is spoken or written by people (humans) for
general purpose communication. There are 5 phases involved in natural language processing:

1. Morphological
2. Lexical Analysis
3. Syntactic Analysis
4. Semantic Analysis
5. Discourse Integration
6. Pragmatic Analysis

In morphological
analysis, component wise analysis of individual words is done in non-word tokens like
punctuation are separated from the words. This process usually assigns syntactic categories to the
words in s sentence. To build a syntactic representation of the input sentence, a parser must map
each word in the text to some canonical representation and recognize its morphological
properties.

Morphology depicts analyzing, identifying and description of structure of words. Lexical


analysis involves dividing a text into paragraphs, words and the sentences. The lexical analysis
however cannot be performed in isolation from morphological and syntactic analysis. For
instance, unusually can be thought of as composed of a prefix un-, a stem usual, and an affix -ly.
Composed is compose plus the inflectional affix -ed: a spelling rule means we end up with
composed rather than composeed.

Syntactic analysis involves analyzing the words in a sentence to depict the grammatical structure
of the sentence. The words are transformed into structure that shows how the words are related to
each other e.g. “the girl the go to the school”. This would definitely be rejected by the English
syntactic analyzer. In syntactic analysis, sequences of words are transformed into structure in
which show the relation of words to each other. Violation of the language rules mean that the
sentence may be rejected as in the example above.

The next step is the Semantic analysis in which meanings are assigned to the structures created
by the syntactic analyzer. A semantic knowledge is the study of context independent meaning
that is the sentence meaning regardless of the context of the usage. A semantic analyzer must do
the following:

 Mapping of individual words into appropriate objects in the knowledge base or


database
 Creating the correct structures to correspond to how the meanings of the
individual words combine with one another
 A mapping is made between the syntactic structures and objects in the task
domain. If such mapping is not possible, those structures may be rejected.

For instance, “colorless blue idea” .This would be rejected by the analyzer as colorless blue do
not make any sense together.

The fourth step is Discourse Integration. The meaning of any single sentence depends upon the
sentences that precedes it and also invokes the meaning of the sentences that follow it. For
example the word “it” in the sentence “she wanted it” depends upon the prior discourse context.
The last but not least is the Pragmatic Analysis. It means abstracting or deriving the purposeful
use of the language in situations importantly those aspects of language which require world
knowledge the main focus is on what was said is reinterpreted on what it actually means. For
example “closethewindow?” should have been interpreted as a request rather than an order.
Pragmatic knowledge concerns how sentences are used in different situations and how the
interpretation of the sentence is affected by the use.

References
Christopher D. Manning, Hinrich Schutze (2000) “Foundations of Statistical natural Language
Processing”. Pearson education MIT Press

Peter Jackson, Isabelle Moulinier (2002) “Natural Language Processing For Online
Applications: Text Retrieval, Extraction and Categorization”. John Benjamins Publishing
Company

Robert Dale, Kam Fei Wong, Jian Su, OI Yee Kwong (2005) “Natural Language Processing” 2nd
International Joint Conference, Jeju Island, Korea Preccedings

Natural Language Processing-Computer science and engineering


http://www.cse.unt.edu/~rada/CSCE5290/Lectures/Intro.ppt

You might also like