Support Vector Machine-Updated Version
Support Vector Machine-Updated Version
• Hyperplane.
• Support Vectors.
• Margin.
• Kernel Trick.
2
KEY CONCEPTS ASSOCIATED WITH SUPPORT VECTOR
MACHINES
Hyperplane:
• A hyperplane is a boundary that separates the data from
low dimension to high dimension i.e. from 2D to 3D into
two classes.
• In a two-dimensional space it’s a line, in three dimensions,
it's a plane, and so on.
• The goal of SVM is to find the hyperplane that best
separates the data into different classes. 3
HYPERPLANE
4
5
KEY CONCEPTS ASSOCIATED WITH SUPPORT VECTOR MACHINES
• Support Vectors: Support vectors are the data points that are closest
to the hyperplane and have the most influence on its position. These
are the critical elements in determining the optimal hyperplane.
• Margin: The margin is the distance between the hyperplane and the
nearest data point from each class. SVM aims to maximize this
margin because a larger margin generally leads to better
generalization to unseen data.
• 6
7
https://www.youtube.com/watch?v=eNyUfpGBLts
https://www.youtube.com/watch?v=xLkk6MUrvrw&t=3s
KERNEL
8
9
KERNEL TRICK
• Kernel Trick: SVM can handle non-linear decision boundaries through the
use of the kernel trick. Kernels allow SVM to implicitly map the input data
into higher-dimensional feature spaces, making it possible to find a linear
decision boundary in that space.
10
TYPES OF SVM
11
12
https://www.youtube.com/watch?v=0MJTaPoHv-g
13
https://www.youtube.com/watch?v=owsAQ_fiwIw