Support Vector Machine (SVM) is a supervised machine learning algorithm primarily used for classification, aiming to create the best decision boundary or hyperplane to segregate data into classes. There are two types of SVM: Linear SVM for linearly separable data and Non-linear SVM for non-linearly separable data, with the latter utilizing kernel functions to transform data into higher dimensions. The document also includes examples illustrating the application of Non-linear SVM classifiers.
Support Vector Machine (SVM) is a supervised machine learning algorithm primarily used for classification, aiming to create the best decision boundary or hyperplane to segregate data into classes. There are two types of SVM: Linear SVM for linearly separable data and Non-linear SVM for non-linearly separable data, with the latter utilizing kernel functions to transform data into higher dimensions. The document also includes examples illustrating the application of Non-linear SVM classifiers.
Theory {Definitions} 1. What is SVM ? ANS: SVM is a one of the most popular supervised machine learning algorithm, which can be used for both classification and regression but mainly used in area of classification. Main goal of SVM is to create best fit line or boundary that can segregate n-dimensional space into classes, so that we can put the data point in correct category for future prediction.
1. What is hyperplane in SVM ?
The best decision boundary is called hyper-plane. SVM choses the extreme points/vectors that helps in creating a hyper-plane. These extreme cases are called as support vectors. Hence algorithm is termed as support vector machine. 1. Hyperplane in SVM What are different types of SVM ?
There are mainly two types of SVM
1. Linear SVM: Linear SVM is used for linearly separable data,
which means if a dataset can be classified into two classes by using a single straight line, then such data is termed as linearly separable data, and classifier is used called as Linear SVM classifier.
1. Non-linear SVM: Non-Linear SVM is used for non-linearly
separated data, which means if a dataset cannot be classified by using a straight line, then such data is termed as non-linear data and classifier used is called as Non-linear SVM classifier. What is the use of Kernel in non-Linear SVM ?
In non-linear SVM we will use Kernel SVM to convert low dimensional
data into high dimensional data so that small hyper plane will be created. Numerical example for
Non-Linear SVM: Nayan Kumar S. Behera Example-1 1. Suppose we are given the following positively labeled data points
and the following negatively labeled data points.
Example-2 Suppose we are given the positively labeled data points are {(2, 2), (2, -2) (-2, -2), (-2,2) } and the negatively labeled data points are{(1,1),(1,-1),(-1,-1),(-1,1)}. Find the non-linear SVM and find the class label of (2, 3). Example-3 Find the SVM classifier for the following dataset Example-3 Find the SVM classifier for the following dataset What is the use of Kernel in non-Linear SVM ?
In non-linear SVM we will use Kernel SVM to convert low dimensional
data into high dimensional data so that small hyper plane will be created.