Machine Learning (ML) Class Notes
What is Machine Learning?
Machine Learning (ML) is a subfield of Artificial Intelligence (AI) that
focuses on enabling computers to learn from data without explicit
programming. Instead of relying on hard-coded rules, ML algorithms
identify patterns, make predictions, and improve their performance over
time by being exposed to more data. They build models from data that
can then be used to make decisions or predictions on new, unseen data.
Key Concepts:
Data: The raw material for machine learning. Can be labeled (with
known outputs) or unlabeled.
Model: A representation of the patterns and relationships in the
data.
Algorithm: A set of instructions that the model uses to learn from
the data.
Training: The process of feeding data to the algorithm to build or
refine the model.
Prediction: Using the trained model to make predictions on new
data.
Evaluation: Assessing the performance of the model using
metrics.
Types of Machine Learning:
Supervised Learning: The algorithm learns from labeled data
(input-output pairs). The goal is to predict the output for new
inputs.
o Classification: Predicting a categorical output (e.g., spam or
not spam).
o Regression: Predicting a continuous output (e.g., house
price).
Unsupervised Learning: The algorithm learns from unlabeled
data. The goal is to find patterns and structures in the data.
o Clustering: Grouping similar data points together.
o Dimensionality Reduction: Reducing the number of
features while preserving important information.
o Association Rule Learning: Discovering relationships
between variables.
Reinforcement Learning: The algorithm learns through trial and
error by interacting with an environment. It receives rewards or
penalties for its actions.
Key Steps in a Machine Learning Project:
1. Data Collection: Gathering relevant data.
2. Data Preprocessing: Cleaning, transforming, and preparing the
data for training. This often includes handling missing values,
encoding categorical features, and scaling numerical features.
3. Feature Engineering: Selecting, transforming, or creating features
that improve the model's performance.
4. Model Selection: Choosing an appropriate machine learning
algorithm based on the problem type and data characteristics.
5. Model Training: Training the chosen model on the training data.
6. Model Evaluation: Assessing the model's performance on a
separate test dataset.
7. Hyperparameter Tuning: Adjusting the model's parameters to
optimize its performance.
8. Deployment: Deploying the trained model for real-world use.
9. Monitoring and Maintenance: Continuously monitoring the
model's performance and retraining it as needed.
Common Machine Learning Algorithms:
Linear Regression: For regression tasks, assumes a linear
relationship between input and output.
Logistic Regression: For classification tasks, predicts the
probability of a class.
Decision Trees: Tree-like structures that make decisions based on
features.
Random Forests: An ensemble method that combines multiple
decision trees.
Support Vector Machines (SVMs): Finds the optimal hyperplane
to separate data points.
K-Nearest Neighbors (KNN): Classifies data points based on the
majority class among their k-nearest neighbors.
Neural Networks: Complex networks of interconnected nodes
inspired by the human brain.
Clustering Algorithms (K-Means, DBSCAN): Group similar
data points together.
Evaluation Metrics:
Accuracy: The percentage of correctly classified instances.
Precision: The proportion of true positives among the predicted
positives.
Recall: The proportion of true positives among the actual
positives.
F1-score: The harmonic mean of precision and 1 recall.
Mean Squared Error (MSE): Measures the average squared
difference between predicted and actual values (for regression).
R-squared: Measures the goodness of fit of a regression model.
Challenges in Machine Learning:
Overfitting: The model performs well on the training data but
poorly on unseen data.
Underfitting: The model is too simple to capture the underlying
patterns in the data.
Bias: The model makes systematic errors due to biases in the data.
Data Quality: Noisy or incomplete data can affect model
performance.
Computational Resources: Training complex models can require
significant computational power.
Tools and Libraries:
Python: A popular programming language for machine learning.
Scikit-learn: A comprehensive library for machine learning
algorithms and tools.
TensorFlow: A deep learning framework.
PyTorch: Another popular deep learning framework.
Pandas: A library for data manipulation and analysis.
NumPy: A library for numerical computing.
Further Study:
Machine learning is a rapidly growing field. Further study should
include delving deeper into specific algorithms, understanding the
mathematical foundations of machine learning, exploring different
evaluation metrics, and gaining hands-on experience through projects.
Keeping up with the latest research and advancements in the field is also
important.
