Deep Learning using Python
1. Data Processing:
Panda’s plotting
Exploratory Data Processing
Dashboard creation for data visualization
2. Introduction to Neural Networks:
Biological inspiration for artificial neural networks
Perceptron and activation functions
Perceptron model classifier
What is MLP (Multilayer perceptron model)
Mathematical formulation
Sklearn MLPclassifier Model
Sklearn MLPRegressor Model
activation functions
fine-tune the model’s performance including number of hidden layers, activation
functions.
Forward propagation and backpropagation algorithms
Loss functions and gradient descent
3. Deep Learning Frameworks :
Introduction to deep learning libraries/frameworks (e.g., TensorFlow, Keras, PyTorch)
Installation and setup of a deep learning environment
Implementing custom training loops and gradient
Distributed training with TensorFlow
TensorFlow Hub for reusable model components
Overview of Keras features and advantages
Sequential vs. Functional API in Keras
Different types of layers available in Keras (e.g., Dense, Conv2D, LSTM, etc.).
Specifying loss functions and optimizers
Feeding data into Keras models.
Batch size and epoch concepts.
Model Evaluation and Prediction
What is PyTorch and its advantages?
Understanding PyTorch tensors and their operations.
Creating neural network architectures using [Link].
Setting up the data pipeline with Data Loader.
Evaluating model performance on test data.
Will Explore more in coming sessions using deep neural networks with these
frameworks.
Exporting models for deployment in various environments (e.g., TensorFlow Serving,
TensorFlow Lite, [Link])
Code examples using TensorFlow, Keras, or PyTorch
4. Convolutional Neural Networks (CNNs) :
Introduction to Convolutional Neural Networks
How CNNs differ from fully connected networks.
Applications of CNNs in image classification, object detection, and more.
Understanding convolutional operations and filters
Stride, padding, and their impact on feature map dimensions, Pooling Layers.
Reducing spatial dimensions while preserving essential features
Deep Learning using Python
Popular activation functions used in CNNs (e.g., ReLU, Leaky ReLU).
CNN Architectures like LeNet, AlexNet, VGG, ResNet, Inception
Understanding the design principles of different architectures
Forward and backward pass in CNNs.
Using pre-trained CNN models
Understanding Popular object detection architectures (e.g., YOLO, SSD).
Architectures for semantic segmentation
Using gradient-based methods for visualizing activations, Hyperparameter Tuning.
Object detection and image segmentation with CNNs
Using Python libraries (e.g., TensorFlow, Keras, PyTorch) to build CNNs.
Using high-level APIs (e.g., Keras, PyTorch Lightning) for streamlined development.
Provide real-world datasets to implement CNN.
5. Recurrent Neural Networks (RNNs) :
Introduction to Recurrent Neural Networks
What are RNNs and their role in sequential data processing?
RNN Architecture
Applications of RNNs in natural language processing, speech recognition, and time
series analysis.
Anatomy of an RNN cell (e.g., simple RNN cell, LSTM cell, GRU cell).
Understanding vanishing and exploding gradients in RNNs.
Long Short-Term Memory (LSTM)
Introduction to LSTM cells and their advantages over simple RNNs.
Solving long-term dependencies with LSTMs.
Introducing bidirectional RNNs for capturing past and future context.
Backpropagation through time for training RNNs.
Language modelling and next word prediction.
Sequence-to-sequence models for machine translation and chatbots.
Introduction to encoder-decoder architectures in NLP and other tasks.
Implementing sequence-to-sequence models with RNNs.
Transfer Learning with RNNs
Using pre-trained RNN models
Using Python libraries (e.g., TensorFlow, Keras, PyTorch) to build RNNs.
Applications of RNNs in natural language processing and time series analysis
Combining CNNs and RNNs for image captioning and video analysis.
Padding and masking in RNNs.
Provide real-world datasets to implement RNNs.
6. Generative Adversarial Networks (GANs) :
Introduction to GANs
What are GANs and their significance in generative modeling
Understanding the GAN architecture.
Deep Learning using Python
The generator network: generating synthetic data
The discriminator network: distinguishing between real and fake data.
The adversarial process: training the generator and discriminator.
The GAN training process and loss functions (e.g., minimax, Wasserstein loss).
Introducing DCGANs and their architecture.
GANs to generate data conditioned on specific labels or attributes.
how GANs can be used for artistic style transfer.
Using GANs to augment datasets for training other models.
GAN-generated data to enhance model performance.
Generating text using GANs and variants (e.g., SeqGAN).
Text-to-image synthesis with GANs.
Introducing GANs for 3D object synthesis.
Conditional GANs and style transfer
Using Python libraries (e.g., TensorFlow, Keras, PyTorch) to build GANs.
Work on real time problem to build data using GANs.
7. Transfer Learning :
What is transfer learning and its importance in deep learning?
Understanding the challenges of training models from scratch.
Overview of popular pre-trained models (e.g., VGG, ResNet, Inception).
Understanding the datasets used for pre-training.
How to load and use pre-trained models in popular deep learning frameworks (e.g.,
TensorFlow,Keras , PyTorch).
Deciding which layers to freeze and which to fine-tune.
Transfer Learning for Image Classification
Adapting pre-trained image classification models to new datasets.
Fine-tuning hyperparameters for optimal performance.
Transferring knowledge from a source domain to a target domain with different data
distributions.
Using unsupervised learning to pre-train models on large datasets.
Transfer learning with limited labelled data.
Understanding the scenarios where transfer learning might not work effectively.
Real-world applications of transfer learning
8. Generative Ai and LLMS :
Introduction to Large Language Models and Generative AI
Applications and impact of LLMs and Generative AI
Fundamental Concepts and Architectures
BERT, GPT, and other LLMs
Training Large Language Models
Data collection and preprocessing
Training techniques and optimization
Fine-Tuning and Transfer Learning
Generative AI Techniques
Practical Applications of LLMs
Capstone Project:
Deep Learning using Python
Apply deep learning techniques learned throughout the curriculum to build a significant project or
solve a specific problem.
