Scribd
Upload
31 views

Machine Learning: Emmanuel Okafor, PH.D., M.SC., B.Eng

Machine learning involves using algorithms to learn from data and optimize model parameters to make predictions or decisions without being explicitly programmed. There are three main types of machine learning problems: supervised learning which involves predicting a target output given input data; unsupervised learning which finds patterns in unlabeled input data; and reinforcement learning which learns optimal behavior from interactions with an environment. Supervised learning includes classification to categorize data and regression to predict continuous values. Unsupervised learning includes clustering to group similar data. Reinforcement learning learns policies for sequential decision making.

Uploaded by

Abubakar
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
31 views

Machine Learning: Emmanuel Okafor, PH.D., M.SC., B.Eng

Machine learning involves using algorithms to learn from data and optimize model parameters to make predictions or decisions without being explicitly programmed. There are three main types of machine learning problems: supervised learning which involves predicting a target output given input data; unsupervised learning which finds patterns in unlabeled input data; and reinforcement learning which learns optimal behavior from interactions with an environment. Supervised learning includes classification to categorize data and regression to predict continuous values. Unsupervised learning includes clustering to group similar data. Reinforcement learning learns policies for sequential decision making.

Uploaded by

Abubakar
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 13

Machine Learning

Emmanuel Okafor, Ph.D., M.Sc., B.Eng.


Outline
• Introduction
 Supervised learning
 Classification task
 Regression task
 Unsupervised learning
 Reinforcement learning
Introduction
• What is Machine Learning?

 Machine learning is programming computers to


optimize a performance criterion using
example data or past experience.

 We have model defined up to some parameters,


and learning is the execution of a computer
program to optimize the parameters of the
model using the training data or past
experience.

 The model may be predictive to make


predictions in the future, or descriptive to
gain knowledge from data, or both.
Introduction
• The core objective of machine learning;
 Learning
 Inference
Introduction
Pictorial illustration of machine learning problems
Introduction
• Machine Learning Problems

1. Supervised Learning
 In supervised learning, the aim is to learn a mapping
from the input to an output whose correct values are
provided by a supervisor.

 The approach in machine learning is that we assume a


model defined up to a set of parameters: y = g(x|θ)

 where g(·) is the model and θ are its parameters. Y is a


number in regression and is a class code (e.g., 0/1) in
the case of classification. g(·) is the regression
function or in classification, it is the discriminant
function separating the instances of different classes.

 The machine learning program optimizes the parameters,


θ, such that the approximation error is minimized, that
is, our estimates are as close as possible to the
correct values given in the training set.
Introduction
• Machine Learning Problems
1. Supervised Learning
a) Classification After training with the past data, a
classification rule learned may be of
the form

 IF income>θ1 AND savings>θ2 THEN


low-risk ELSE high-risk, for
suitable values of θ1 and θ2

 Discriminant; it is a function
that separates the examples of
different classes.

 Prediction: Once we have a rule


that fits the past data, if the
future is similar to the past, then
we can make correct predictions for
novel instances.
Introduction
Classification Examples;
 There are many applications of machine
learning in pattern recognition. One is
optical character recognition, which is
recognizing character codes from their images.

 In the case of face recognition, the input is


an image, the classes are people to be
recognized, and the learning program should
learn to associate the face images to
identities.

 In medical diagnosis, the inputs are the


relevant information we have about the patient
and the classes are the illnesses.
Introduction
Classification Examples;
 In speech recognition, the input is acoustic and
the classes are words that can be uttered. This
time the association to be learned is from an
acoustic signal to a word of some language.

 Biometrics is recognition or authentication of


people using their physiological and/or behavioral
characteristics that requires an integration of
inputs from different modalities.

 In the case of animal recognition, the input is an


image, the classes are different animals to be
recognized, and the learning program should learn
to associate the animal images to identities (PhD
research project).
Introduction
1. Supervised Learning
b) Regression
y = wx + w0
for suitable values of w and
w0; y = price of car;
x = mileage

NOTE: Both regression and


classification are
supervised learning problems
where there is an input, X,
an output, Y, and the task is
to learn the mapping from
the input to the output.
Introduction
2. Unsupervised Learning
 In unsupervised learning,
there is no such supervisor
and we only have input
data. The aim is to find
the regularities in the
input.

 The idea is similar to


density estimation in
statistics. One method for
density estimation is
clustering where the aim is
to find clusters or
groupings of input.

 Examples; customer
segmentation, image
compression, and document
clustering,
Introduction
3. Reinforcement Learning
 In such a case, the machine learning program
should be able to assess the goodness of
policies and learn from past good action
sequences to be able to generate a policy.
Such learning methods are called reinforcement
learning algorithms.

 Example: Game Design, Robotics, and


Optimization
Thanks for Listening

You might also like