Unit 1:Neural Networks and

Deep Learning
By:
Prof. Swati S. Killikatt
 Introduction to AI, ML and Deep Learning

• Artificial intelligence (AI) is the ability of

machines to replicate or enhance human
intellect, such as reasoning and learning from
experience.
• Machine Learning (ML) makes computers
learn from data and experience to improve
their performance on some tasks or decision-
making processes.
• Deep learning is a subset of machine learning
that uses multi-layered artificial neural
networks to deliver state-of-the-art accuracy
in object detection, speech recognition and
language translation.
• Example:
– driverless cars
– recognizing the faces of people who appear in an
image or video.
Difference between Machine Learning and Deep Learning :

Machine Learning Deep Learning

Works on small amount of Dataset for accuracy. Works on Large amount of Dataset.

Dependent on Low-end Machine. Heavily dependent on High-end Machine.

Divides the tasks into sub-tasks, solves them

individually and finally combine the results. Solves problem end to end.

Takes less time to train. Takes longer time to train.

Testing time may increase. Less time to test the data.

Working of deep learning
• Tools used : Anaconda, Jupyter, Pycharm, etc.

• Languages used : R, Python, Matlab, CPP,

Java, Julia, Lisp, Java Script, etc.
• Examples :
• How to recognize square from other shapes?
– ...a) Check the four lines!
– ...b) Is it a closed figure?
– ...c) Does the sides are perpendicular from each
other?
– ...d) Does all sides are equal?

• So, Deep Learning is a complex task of identifying the

shape and broken down into simpler tasks at a larger side.
 Applications :

• Automatic Text Generation – Corpus of text is learned and from this model new text
is generated, word-by-word or character-by-character. Then this model is capable of
learning how to spell, punctuate, form sentences, or it may even capture the style.
• Healthcare – Helps in diagnosing various diseases and treating it.
• Automatic Machine Translation – Certain words, sentences or phrases in one
language is transformed into another language (Deep Learning is achieving top
results in the areas of text, images).
• Image Recognition – Recognizes and identifies peoples and objects in images as well
as to understand content and context. This area is already being used in Gaming,
Retail, Tourism, etc.
• Predicting Earthquakes – Teaches a computer to perform viscoelastic computations
which are used in predicting earthquakes.
• Deep learning has a wide range of applications in various fields such as computer
vision, speech recognition, natural language processing, and many more. Some of
the most common applications include
• Image and video recognition: Deep learning models are used to
automatically classify images and videos, detect objects, and identify faces.
Applications include image and video search engines, self-driving cars, and
surveillance systems.
• Speech recognition: Deep learning models are used to transcribe and
translate speech in real-time, which is used in voice-controlled devices,
such as virtual assistants, and accessibility technology for people with
hearing impairments.
• Natural Language Processing: Deep learning models are used to
understand, generate and translate human languages. Applications include
machine translation, text summarization, and sentiment analysis.
• Robotics: Deep learning models are used to control robots and drones, and
to improve their ability to perceive and interact with the environment.
• Healthcare: Deep learning models are used in medical imaging to detect
diseases, in drug discovery to identify new treatments, and in genomics to
understand the underlying causes of diseases.
• Finance: Deep learning models are used to detect fraud, predict stock prices,
and analyze financial data.
• Gaming: Deep learning models are used to create more realistic characters
and environments, and to improve the gameplay experience.
• Recommender Systems: Deep learning models are used to make personalized
recommendations to users, such as product recommendations, movie
recommendations, and news recommendations.
• Social Media: Deep learning models are used to identify fake news, to flag
harmful content and to filter out spam.
• Autonomous systems: Deep learning models are used in self-driving cars,
drones, and other autonomous systems to make decisions based on sensor
data.
 Basics of neural network:

• Neural networks are used to mimic the basic

functioning of the human brain and are
inspired by how the human brain interprets
information.
• It is used to solve various real-time tasks
because of its ability to perform computations
quickly and its fast responses.
 Types of Neural Networks

• (i) ANN– It is also known as an artificial neural network.

• It is a feed-forward neural network because the inputs
are sent in the forward direction.
• It can also contain hidden layers which can make the
model even denser.
• They have a fixed length as specified by the programmer.
It is used for Textual Data or Tabular Data.
• A widely used real-life application is Facial Recognition. It
is comparatively less powerful than CNN and RNN.
• (ii) CNN–
• It is known as Convolutional Neural Networks. It
is mainly used for Image Data.
• It is used for Computer Vision. Some of the real-
life applications are object detection in
autonomous vehicles.
• It contains a combination of convolutional
layers and neurons.
• It is more powerful than both ANN and RNN.
• (iii) RNN–
• It is known as Recurrent Neural Networks.
• It is used to process and interpret time series
data. In this type of model, the output from a
processing node is fed back into nodes in the
same or previous layers.
• The most known types of RNN are LSTM (Long
Short Term Memory) Networks
• There are 3 types of learning's in Neural
networks, namely
• Supervised Learning

• Unsupervised Learning

• Reinforcement Learning
• Supervised Learning:
• As the name suggests, it is a type of learning that is looked after
by a supervisor.
• It is like learning with a teacher.
• There are input training pairs that contain a set of input and the
desired output.
• Here the output from the model is compared with the desired
output and an error is calculated, this error signal is sent back into
the network for adjusting the weights.
• This adjustment is done till no more adjustments can be made
and the output of the model matches the desired output. In this,
there is feedback from the environment to the model.
• Unsupervised Learning:
• Unlike supervised learning, there is no supervisor or a teacher
here.
• In this type of learning, there is no feedback from the
environment, there is no desired output and the model learns
on its own.
• During the training phase, the inputs are formed into classes
that define the similarity of the members.
• Each class contains similar input patterns.
• On inputting a new pattern, it can predict to which class that
input belongs based on similarity with other patterns. If there is
no such class, a new class is formed.
• Reinforcement Learning:
• It gets the best of both worlds, that is, the best of both Supervised
learning and Unsupervised learning.
• It is like learning with a critique.
• Here there is no exact feedback from the environment, rather
there is critique feedback.
• The critique tells how close our solution is
• Hence the model learns on its own based on the critique
information.
• It is similar to supervised learning in that it receives feedback from
the environment, but it is different in that it does not receive the
desired output information, rather it receives critique information.
 Data representation for neural network:

• Scalars (0D tensors):

– A Tensor that contains only one number called a
scalar (0-dimensional tensor ). In NumPy, float32
or float64 number is a scalar-tensor.
• Vectors (1D tensors):
– An array of numbers is called vectors or 1D
tensors. A 1D tensor has exactly one axis.
• 3. Matrices (2D tensors):
– An array of vectors is a matrix or 2D tensor. A
matrix has two axes (row and column).
• 4. 3D tensor and higher-dimensional tensor:
– e.g: x = np.array([[[1,2,3,4,5], [8,9,10,1,2],
[3,8,9,1,2]],[[8,9,1,5,4],[3,8,10,12,6],[2,3,5,10,6]]])
– the above data is a 5D vector, 3D tensor and 2
axes. thus the shape of x=(3,2), where 3 is the
number of tensor and 2 is the axes.