Notes On Artificial Intelligence
Notes On Artificial Intelligence
PREPARED BY
Mr. Shivansh Mittal
(Assistant Professor)
1
Introduction to Artificial Intelligence
2
logic, which later became the foundation for AI
algorithms.
• Alan Turing (1936):
Turing introduced the concept of a "universal machine"
(Turing Machine) that could simulate any algorithmic
process. His work laid the theoretical foundation for
modern computers and AI.
• 1950s - Birth of AI:
The field officially began in 1956 at the Dartmouth
Conference, where John McCarthy coined the term
"Artificial Intelligence." Early AI research focused on
symbolic AI, using logic and rules to mimic human
thought processes.
• Expert Systems (1970s-1980s):
These were rule-based systems designed to replicate the
decision-making ability of human experts in specific
domains (e.g., medical diagnosis).
• AI Winter:
Periods of reduced funding and interest in AI research
occurred due to unmet expectations, leading to what is
known as "AI Winter."
• Resurgence (1990s-Present):
Advances in computing power, availability of large
datasets, and new algorithms (like neural networks)
revived AI research. Today, AI is a critical field with
applications in almost every sector.
3
2. Present State of AI
The present state of AI is characterized by rapid advancements
and widespread adoption. Key technologies driving this
evolution include:
• Machine Learning: A subset of AI that focuses on
developing algorithms that allow computers to learn from
and make predictions based on data. It includes:
o Supervised Learning: Where the model is trained
on a labeled dataset.
o Unsupervised Learning: Where the model finds
4
Example:
An AI-powered virtual assistant like Siri or Google Assistant
uses a combination of NLP, machine learning, and voice
recognition to perform tasks such as setting reminders,
answering questions, and controlling smart home devices.
3. Application Areas of AI
5
• Transportation: Autonomous vehicles, traffic
management systems, and predictive maintenance in
logistics are driven by AI. Companies like Tesla and
Waymo are leading the development of self-driving cars.
• Retail: AI enhances customer experience through
personalized recommendations, inventory management,
and demand forecasting. For example, Amazon uses AI
algorithms to recommend products to customers based on
their browsing and purchase history.
• Entertainment: AI is used in content recommendation
engines (e.g., Netflix, Spotify), game development, and
even creating new art and music through generative
models.
Example:
In autonomous vehicles, AI is applied in computer vision (to
detect objects on the road), sensor fusion (to combine data from
multiple sources), and decision-making algorithms (to navigate
safely).
4. Nature of AI Problems
AI problems are diverse and can be categorized based on the
nature of the tasks they involve. These problems often require
a combination of reasoning, learning, perception, and
interaction with an environment.
Types of AI Problems:
• Classification Problems: Categorizing data into
predefined classes. For example, identifying whether an
email is spam or not.
6
• Regression Problems: Predicting a continuous value,
such as forecasting stock prices or predicting housing
prices.
• Optimization Problems: Finding the best solution from
a set of possible solutions, such as route optimization in
logistics.
• Decision-Making Problems: Selecting the best action in
a given situation, such as choosing the next move in a
game of chess.
• Perception Problems: Interpreting sensory data, like
recognizing objects in an image or understanding spoken
language.
Example:
An AI problem in healthcare might involve predicting the
likelihood of a patient developing a certain condition based on
their medical history and lifestyle factors. This problem would
involve classification, regression, and decision-making.
5. Examples of AI Problems
• Speech Recognition:
7
Converting spoken language into text. This involves
processing audio signals, understanding context, and
handling variations in accents and speech patterns.
Applications include virtual assistants, transcription
services, and voice-controlled devices.
• Game Playing:
8
• Medical Diagnosis:
10
Example:
A modern example of a system that might attempt to pass the
Turing Test is OpenAI's GPT series of models, which can
generate human-like text based on prompts. While these
models can produce coherent and contextually relevant
responses, passing the Turing Test in a comprehensive manner
is still a challenging task.
7. Learning Agents
Problem Representation in AI
1. Problem Solving Techniques
Problem-solving in AI involves developing methods to
achieve specific goals. These methods can be broadly
categorized into:
• Search-Based Techniques: Exploring a space of possible
solutions (state space) to find a path to the goal. Examples
include depth-first search, breadth-first search, and A*
algorithm.
• Optimization Techniques: Finding the best solution
among many possible solutions. Techniques include linear
programming, genetic algorithms, and simulated
annealing.
12
• Logical Reasoning: Using formal logic to derive
conclusions from a set of premises. This approach is used
in expert systems and theorem proving.
• Learning-Based Techniques: Learning from data to
make decisions or predictions. Techniques include
supervised learning, unsupervised learning, and
reinforcement learning.
Example:
In a navigation system, problem-solving might involve finding
the shortest route between two locations. The system uses
search algorithms (like A*) to explore possible routes and
optimization techniques to choose the best one.
2. State Space Search
13
Components:
• States: Represent different configurations or conditions in
the problem domain. For example, in a chess game, each
arrangement of pieces on the board is a state.
• Actions: Operations that transition the system from one
state to another. In chess, an action would be moving a
piece.
• Goal State: The desired outcome that the problem-
solving process aims to achieve. In a maze-solving
problem, the goal state is reaching the exit.
Example:
In a puzzle game like the 8-puzzle, where the goal is to arrange
the tiles in a specific order, the state space consists of all
possible arrangements of the tiles. The problem-solving
process involves searching through this state space to find a
sequence of moves that leads to the goal arrangement.
3. Control Strategies
14
significantly impacts the efficiency and effectiveness of
problem-solving.
Types of Control Strategies:
• Uninformed (Blind) Search: These strategies do not use
domain-specific knowledge and explore the state space
systematically.
o Breadth-First Search (BFS): Explores all possible
15
4. Heuristic Search
Heuristic search is an informed search strategy that uses
heuristics to estimate the cost or distance to the goal from the
current state. This approach allows the search process to focus
on the most promising paths, making it more efficient.
Key Concepts:
• Heuristic Function (h): A function that estimates the cost
to reach the goal from a given state. For example, in a
navigation problem, the heuristic might be the straight-
line distance to the destination.
• Admissibility: A heuristic is admissible if it never
overestimates the cost to reach the goal. This ensures that
the search algorithm finds the optimal solution.
• A Algorithm:* A popular heuristic search algorithm that
combines the actual cost to reach a state (g) and the
estimated cost to reach the goal (h) to guide the search.
Example:
In a navigation system, the heuristic might estimate the travel
time to the destination based on the current location and road
conditions. The A* algorithm would use this heuristic to find
the fastest route.
5. Problem Characteristics
The characteristics of a problem influence the choice of
problem-solving techniques and strategies. Understanding
these characteristics helps in selecting the most appropriate
approach.
16
Key Problem Characteristics:
• Completeness: Whether the search strategy guarantees
finding a solution if one exists.
• Optimality: Whether the strategy guarantees finding the
best solution.
• Time Complexity: The time required to solve the
problem, often measured in terms of the number of states
explored.
• Space Complexity: The amount of memory required to
solve the problem.
• Determinism: Whether the outcome of actions is
predictable. In deterministic problems, the same action
always leads to the same result.
Example:
In a deterministic and fully observable problem like tic-tac-toe,
a simple search strategy can guarantee finding the optimal
solution. However, in a non-deterministic and partially
observable problem like poker, more complex strategies
involving probability and learning are required.
17