Scribd
Upload
71 views11 pages

Understanding Support Vector Machines

Support Vector Machine (SVM) is a supervised machine learning algorithm primarily used for classification, aiming to create the best decision boundary or hyperplane to segregate data into classes. There are two types of SVM: Linear SVM for linearly separable data and Non-linear SVM for non-linearly separable data, with the latter utilizing kernel functions to transform data into higher dimensions. The document also includes examples illustrating the application of Non-linear SVM classifiers.

Uploaded by

Shivendra Singh
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
71 views11 pages

Understanding Support Vector Machines

Support Vector Machine (SVM) is a supervised machine learning algorithm primarily used for classification, aiming to create the best decision boundary or hyperplane to segregate data into classes. There are two types of SVM: Linear SVM for linearly separable data and Non-linear SVM for non-linearly separable data, with the latter utilizing kernel functions to transform data into higher dimensions. The document also includes examples illustrating the application of Non-linear SVM classifiers.

Uploaded by

Shivendra Singh
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Support Vector Machine

Nayan Kumar S. Behera


Theory {Definitions}
1. What is SVM ?
ANS: SVM is a one of the most popular supervised machine learning algorithm,
which can be used for both classification and regression but mainly used in area
of classification.
Main goal of SVM is to create best fit line or boundary that can segregate
n-dimensional space into classes, so that we can put the data point in correct
category for future prediction.

1. What is hyperplane in SVM ?


The best decision boundary is called hyper-plane. SVM choses the
extreme points/vectors that helps in creating a hyper-plane. These extreme
cases are called as support vectors. Hence algorithm is termed as support
vector machine.
1.
Hyperplane in SVM
What are different types of SVM ?

There are mainly two types of SVM

1. Linear SVM: Linear SVM is used for linearly separable data,


which means if a dataset can be classified into two classes by
using a single straight line, then such data is termed as linearly
separable data, and classifier is used called as Linear SVM
classifier.

1. Non-linear SVM: Non-Linear SVM is used for non-linearly


separated data, which means if a dataset cannot be classified by
using a straight line, then such data is termed as non-linear
data and classifier used is called as Non-linear SVM classifier.
What is the use of Kernel in non-Linear SVM ?

In non-linear SVM we will use Kernel SVM to convert low dimensional


data into high dimensional data so that small hyper plane will be created.
Numerical example for

Non-Linear SVM:
Nayan Kumar S. Behera
Example-1
1. Suppose we are given the following positively labeled data points

and the following negatively labeled data points.


Example-2
Suppose we are given the positively labeled data points
are {(2, 2), (2, -2) (-2, -2), (-2,2) } and the negatively
labeled data points are{(1,1),(1,-1),(-1,-1),(-1,1)}. Find
the non-linear SVM and find the class label of (2, 3).
Example-3
Find the SVM classifier for the following dataset
Example-3
Find the SVM classifier for the following dataset
What is the use of Kernel in non-Linear SVM ?

In non-linear SVM we will use Kernel SVM to convert low dimensional


data into high dimensional data so that small hyper plane will be created.

You might also like