Scribd
Upload
34 views

An Overview of Machine Learning

The document provides an overview of machine learning including definitions, models, algorithms, and applications. It discusses machine learning concepts such as supervised vs unsupervised learning, training and testing data, and performance factors. It also outlines different machine learning algorithms and techniques.

Uploaded by

aishwarya kulkarni
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
34 views

An Overview of Machine Learning

The document provides an overview of machine learning including definitions, models, algorithms, and applications. It discusses machine learning concepts such as supervised vs unsupervised learning, training and testing data, and performance factors. It also outlines different machine learning algorithms and techniques.

Uploaded by

aishwarya kulkarni
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 17

An Overview of

Machine Learning
Outline & Content
 What is machine learning?
 Learning system model
 Training and testing
 Performance
 Algorithms
 Machine learning structure
 What are we seeking?
 Learning techniques
 Applications
What is machine learning?
 A branch of artificial intelligence, concerned wit
h the design and development of algorithms that al
low computers to evolve behaviors based on empiric
al data.

 As intelligence requires knowledge, it is necessar


y for the computers to acquire knowledge.
Learning system model

Testing

Input Learning
Samples Method

System

Training
Training and testing

Data acquisition Practical usage

Universal
set
(unobserved
)

Training set Testing set


(observed) (unobserved
)
Training and testing
 Training is the process of making the system able
to learn.

 No free lunch rule:


 Training set and testing set come from the same distribut
ion
 Need to make some assumptions or bias
Performance
 There are several factors affecting the performanc
e:
 Types of training provided
 The form and extent of any initial background knowledge
 The type of feedback provided
 The learning algorithms used

 Two important factors:


 Modeling
 Optimization
Algorithms
 The success of machine learning system also depend
s on the algorithms. 

 The algorithms control the search to find and buil


d the knowledge structures.

 The learning algorithms should extract useful info


rmation from training examples.
Algorithms
 Supervised learning (
)
 Prediction
 Classification (discrete labels), Regression (real value
s)
 Unsupervised learning ( )
 Clustering
 Probability distribution estimation
 Finding association (in features)
 Dimension reduction
 Semi-supervised learning
 Reinforcement learning
 Decision making (robot, chess machine)
Algorithms

Supervised learning Unsupervised learning

10 Semi-supervised learning
Machine learning structure
 Supervised learning
Machine learning structure
 Unsupervised learning
What are we seeking?
 Supervised: Low E-out or maximize probabilistic te
rms
E-in: for training set
E-out: for testing set

 Unsupervised: Minimum quantization error, Minimum


distance, MAP, MLE(maximum likelihood estimation)
Learning techniques
 Supervised learning categories and techniques
 Linear classifier (numerical functions)
 Parametric (Probabilistic functions)
 Naïve Bayes, Gaussian discriminant analysis (GDA), Hi

dden Markov models (HMM), Probabilistic graphical mod


els
 Non-parametric (Instance-based functions)
 K-nearest neighbors, Kernel regression, Kernel densit

y estimation, Local regression


 Non-metric (Symbolic functions)
 Classification and regression tree (CART), decision t

ree
 Aggregation
 Bagging (bootstrap + aggregation), Adaboost, Random f

orest
Learning techniques
• Linear classifier

, where w is an d-dim vector (learned)

 Techniques:
 Perceptron
 Logistic regression
 Support vector machine (SVM)
 Ada-line
 Multi-layer perceptron (MLP)
Learning techniques
 Unsupervised learning categories and techniques
 Clustering
 K-means clustering

 Spectral clustering

 Density Estimation
 Gaussian mixture model (GMM)

 Graphical models

 Dimensionality reduction
 Principal component analysis (PCA)

 Factor analysis
Applications
 Face detection
 Object detection and recognition
 Image segmentation
 Multimedia event detection
 Economical and commercial usage

You might also like