Diwakar Vishwakarma & Bharti Gupta MCA II Year BBAU(A Central University) Lucknow
AI Concept and Definition
Encompasses Many Definitions
AI Involves Studying Human Thought
Processes Representing Thought Processes on Machines
study of how to make computers do things at which, at the moment, people are better (Rich and Knight [1991]) Theory of how the human mind works (Mark Fox)
AI Objectives
Make machines smarter Understand what intelligence is Make machines more useful (practical purpose)
Turing Test for Intelligence
A computer can be considered to be smart only when a human interviewer, conversing with both an unseen human being and an unseen computer, can not determine which is which.
Major AI Areas
Expert Systems
Natural
Language Processing
Speech Understanding Robotics and Sensory Systems Computer Vision and Scene Recognition Neural Computing Fuzzy Logic
Interaction Level
Natural Language Processing is a technique where machine can become more human and there by reducing the distance between human being and the machine can be reduced. Therefore in simple sense NLP makes human to communicate with the machine easily. NLP applications are very useful in everyday life for example a machine that takes instructions by voice.
Interaction Level
The level that computer and human interact. NL used for make Interaction level near to human.
Graphical UI NL UI Human Interaction level Command-line Computer
Natural?
Natural Language? Natural Language is one of fundamental aspects of human behaviors. Provide easy interaction with computer Refers to the language spoken by people, e.g. English, Japanese, Hindi as opposed to artificial languages, like C++, Java, etc.
Where does it fit in the CS taxonomy?
Computers Databases Artificial Intelligence Algorithms Networking
Robotics
Natural Language Processing
Expert System
Information Retrieval
Machine Translation
Language Analysis
Semantics
Parsing
Natural Language Processing
Natural Language Processing is a collection
used to extract the meaning from input in order to perform the useful task as a result. Automatic analysis of human language by computer algorithms.
Why Natural Language Processing ?
Huge amounts of data Internet = at least 20 billions pages and exponentially increasing
Applications for processing large amounts of texts require NLP expertise
Application Areas of NLP
Text-based applications This involves applications such as searching for a certain topic or a keyword in a data base, extracting information from a large document, translating one language to another or summarizing text for different purposes.
Application Areas of NLP
Dialogue based applications Some of the typical examples of this are answering systems that can answer questions, services that can be provided over a telephone without an operator, teaching systems, voice controlled machines (that take instructions by speech) and general problem solving systems.
Components of Natural Language Processing
Natural Language Understanding o Mapping the given input in the natural language
into a useful representation.
o Different level of analysis required:
morphological analysis , syntactic analysis, semantic analysis, discourse analysis,
Components of Natural Language Processing
Natural Language Generation o Producing output in the natural language from
some internal representation.
o Different level of synthesis required:
deep planning (what to say), syntactic generation
Natural Language Processing
Natural Language Understanding
The steps in natural language understanding are as follows: Words Morphological Analysis Morphologically analyzed words (another step: POS tagging) Syntactic Analysis Syntactic Structure
Natural Language Understanding
Semantic Analysis Context-independent meaning representation Discourse Processing
Final meaning representation
MAJOR TASKS INVOLVED IN NATURAL LANGUAGE PROCESSING
Phonology Morphology Syntax Semantics Pragmatics Discourse
Phonology
Deals with the interpretation of speech sounds within and across words. Three types of rules used in phonological analysis: 1) phonetic rules for sounds within words; 2) phonemic rules for variations of pronunciation when words are spoken together, and; 3) prosodic rules for fluctuation in stress and intonation across a sentence.
Morphology
Morphology is the first stage of analysis once input has been received. It looks at the ways in which words break down into their components and how that affects their grammatical status.
Morphology
Morphemes are the smallest meaningful units of language. cars car+PLU Children Child+PLU
Syntax
Syntax involves applying the rules of the target languages grammar, its task is to determine the role of each word in a sentence and organize this data into a structure that is more easily manipulated for further analysis.
Issues in Syntax
1.
the dog ate my homework - Who did what? Identify the part of speech (POS)
Dog = noun ; ate = verb ; homework = noun English POS tagging: 95% (Can be improved)
Identify collocations mother in law, hot dog
Issues in Syntax
Full Parsing Ravindra loves Khusi.
Ravindra loves Khusi
NP(Ravindra)
VP(loves Khusi)
Verb Noun(R)
NP
loves
Noun(K) Ravindra Love Khusi
More Issues in Syntax
Preposition Attachment I saw the man in the park with a telescope
Semantics
Semantics are the examination of the meaning of words and sentences. Semantics convey Useful information relevant to the scenario as a whole.
Issues in Semantics
Understand language! How? plant = industrial plant plant = living organism Words are ambiguous Importance of semantics?
Machine Translation: wrong translations
Information Retrieval: wrong information
Issues in Semantics
Learn from annotated examples:
Assume 100 examples containing plant
previously tagged by a human Train a learning algorithm How to choose the learning algorithm? How to obtain the 100 tagged examples?
Pragmatics
Pragmatics is the sequence of steps taken that exposes the overall purpose of the statement being analyzed. This will be broken down into ambiguous entities and will be disambiguate to facilitate understanding.
Discourse
Concerns how the immediately preceding sentences affect the interpretation of the next sentence. For example, interpreting pronouns and interpreting the temporal aspects of the information.
Issues in Discourse
Anaphora Resolution: to resolve referring expression The dog entered my room. It scared me Mary bought a book for Kelly. She didnt like it. She refers to Mary or Kelly. -- possibly Kelly It refers to what -- book.
Approaches to Natural Language Processing
Natural language processing approaches fall
roughly into 3 categories:
Symbolic Approach:
Perform
deep analysis of linguistic phenomena
Based
on explicit representation of facts about
language
Approaches to Natural Language Processing
Statistical Approach
Employ various mathematical techniques
Use large text corpora to develop
approximate generalized models of
linguistic phenomena
Approaches to Natural Language Processing
Connectionist Approach
Develop generalized models from
examples of linguistic phenomena
Combine statistical learning with various
theories of representation
Research
Microsoft Natural Language Processing Group The team is broadening the scope of the NLP effort by developing parallel systems in several languages. The languages covered are Chinese, English, French, German, Japanese, Korean and Spanish.
Research
Canon Natural Language Processing Group research and development of large vocabulary speech understanding software, for interactive spoken systems;
Applications of NLP
Machine Translation: different strategies
Systran: www.Systransoft.com
Google: Translate.google.com
Question Answering Information Extraction Spell Checking
Microsoft Spell Checker
Machine Translation
Machine Translation is the process of translating from source language text into target language. There are 2 types of MT: Rule based MT Statistical MT
Machine Translation
Rule based MT Explicit use and manual creation of linguistically informed rules and representations Statistical MT Corpus based, i.e. learned from examples of translations called parallel or bilingual corpora
Applications of Machine Translation
ANGLABHARTI (1991), a machine-aided translation system specifically designed for translating English to Indian languages at IIT Kanpur. Anglabharti uses a pseudo-interlingua approach. It analyses English only once and creates an intermediate structure called PLIL (Pseudo Lingua for Indian Languages).
Applications of Machine Translation
Anusaaraka (1995) project which started at IIT Kanpur, and is now being continued at IIIT Hyderabad Aim of translation from one Indian language to another Anusaaraka's have been built from Telugu, Kannada, Bengali, and Marathi to Hindi. TDIL(Technology Development for Indian Languages) is also working on developing various MT tools
Question Answering
Is a system that automatically answer questions posed by humans in natural language Three steps involved in question answering: Question Manipulation and classification Matching Answer selection
Applications of Question Answering
LUNAR gives access to a data base containing information on lunar rocks and soil composition obtained during the NASA Apollo-11 moon landing mission. It respond to a natural queries of geologist like what is the average of the basalt?
Applications of Question Answering
ELIZA uses the keyword and pattern matching approach. It is based on the use of sentence templates which contain keywords or phrases. Other famous Question Answering systems are-SHRDLU, GUS, JUPITER, QUALM, BASEBALL
Future of NLP
Well there are so many applications we can dream with NLP techniques. How about robots that understand and follow instructions by human voice or driving by talking to the car like in some science fiction movies. Well they all can be real one day. Imagine we have a computer system that can follow simple human instructions and do what ever we want it to do. How convenient will it be ? But lets leave all that to the FUTURE.........
Conclusions
A lot of research is going into developing new applications and investigating new techniques and approaches that will make Statistical NLP more feasible in the near future. So we will be able to see improved applications of NLP in the near future.
References
Blogs on Natural Language Processing from the Microsofts official site. Tutorial on NLP by Saad Ahmad (University of northern Iowa) Coppin, B. (2004). Artificial Intelligence Illuminated.Sudbury, Massachusetts: Jones and Bartlett Publishers Di Eugenio, B. (2001).Natural-Language Processing for Computer-Supported Instruction. Intelligence. Winter 2001
Thank You
