Scribd
Upload
48 views1 page

MLT Formula

The document outlines different machine learning models including linear regression, polynomial regression, ridge regression, lasso, least squares, perceptron, logistic regression, softmax, naive bayes, support vector machines, ID3, CART, gradient boosting, adaboost and k-means clustering. For each model, it lists the model, loss function, optimal solution or weight update approach, and sometimes additional notes.

Uploaded by

swapnil kale
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
48 views1 page

MLT Formula

The document outlines different machine learning models including linear regression, polynomial regression, ridge regression, lasso, least squares, perceptron, logistic regression, softmax, naive bayes, support vector machines, ID3, CART, gradient boosting, adaboost and k-means clustering. For each model, it lists the model, loss function, optimal solution or weight update approach, and sometimes additional notes.

Uploaded by

swapnil kale
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 1

Model (h) Loss [J(w)] Opt-Normal equation (w) Opt-Weight update

Linear Reg

Poly Reg

Ridge

Lasso Use sklearn Use sklearn

Least squares

Perceptron
 

[For one example, sum up for all such examples]

Logistic Reg

Softmax

NOTE: Class label of the highest value of softmax is assigned to the sample (will replace h
in the above equation)

Naive Bayes

- 

NOTE: prior is given as 

and   depends on the distribution

SVM

ID3

where Entropy 

CART

GradientBoost

AdaBoost  (incorrectly classified)

 (correctly classified)

NOTE:  

K-Means

You might also like