Lecture-13

Machine Learning with

Python
Artificial Neural Network(ANN)
▪An Artificial Neural Network (ANN) is a computational model inspired by the
human brain’s neural structure. It consists of interconnected nodes (neurons)
organized into layers.
▪Information flows through these nodes, and the network adjusts the connection
strengths (weights) during training to learn from data, enabling it to recognize
patterns, make predictions, and solve various tasks in machine learning and
artificial intelligence.
 Biological Neural Network Artificial Neural Network

Dendrites Inputs
Cell nucleus Nodes
Synapse Weights
Axon Output

The given figure illustrates the typical diagram of Biological

Neural Network.

The typical Artificial Neural Network looks something like the

given figure
Artificial Neural Network(ANN)
Dendrites from Biological Neural Network represent inputs in Artificial Neural Networks, cell
nucleus represents Nodes, synapse represents Weights, and Axon represents Output.

Biological Neural Network Artificial Neural Network

Dendrites Inputs
Cell nucleus Nodes
Synapse Weights
Axon Output
 ANN..
▪An Artificial Neural Network in the field of Artificial intelligence where it attempts to
mimic the network of neurons makes up a human brain so that computers will have
an option to understand things and make decisions in a human-like manner.
▪The artificial neural network is designed by programming computers to behave simply
like interconnected brain cells.
▪There are around 1000 billion neurons in the human brain. Each neuron has an
association point somewhere in the range of 1,000 and 100,000.
▪In the human brain, data is stored in such a manner as to be distributed, and we can
extract more than one piece of this data when necessary from our memory parallelly.
We can say that the human brain is made up of incredibly amazing parallel processor
ANN example
▪We can understand the artificial neural network with an example, consider an
example of a digital logic gate that takes an input and gives an output. "OR"
gate, which takes two inputs.
▪If one or both the inputs are "On," then we get "On" in output.
▪If both the inputs are "Off," then we get "Off" in output. Here the output
depends upon input. Our brain does not perform the same task.
▪The outputs to inputs relationship keep changing because of the neurons in our
brain, which are "learning."
 Artificial Neural Networks Architecture
There are three layers in the network architecture: the input layer, the hidden layer (more
than one), and the output layer. Because of the numerous layers are sometimes referred to
as the MLP (Multi-Layer Perceptron).
Artificial Neural Networks Architecture
▪It is possible to think of the hidden layer as a “distillation layer,” which extracts
some of the most relevant patterns from the inputs and sends them on to the
next layer for further analysis.
▪It accelerates and improves the efficiency of the network by recognizing just the
most important information from the inputs and discarding the redundant
information.
Activation Function
▪The activation function is important for two reasons: first, it allows you to turn
on your computer.
▪This model captures the presence of non-linear relationships between the
inputs.
▪It contributes to the conversion of the input into a more usable output.
Rectified linear unit (ReL)
Exponential linear unit (elu)
Advantages of Artificial Neural Network
(ANN)
▪Parallel processing capability:
Artificial neural networks have a numerical value that can perform more than
one task simultaneously.
▪Storing data on the entire network:
Data that is used in traditional programming is stored on the whole network, not
on a database. The disappearance of a couple of pieces of data in one place
doesn't prevent the network from working.
▪Capability to work with incomplete knowledge:
After ANN training, the information may produce output even with inadequate
data. The loss of performance here relies upon the significance of missing data.
Advantages of Artificial Neural Network
(ANN)

▪Having a memory distribution:

For ANN is to be able to adapt, it is important to determine the examples and to
encourage the network according to the desired output by demonstrating these
examples to the network. The succession of the network is directly proportional
to the chosen instances, and if the event can't appear to the network in all its
aspects, it can produce false output.
▪Having fault tolerance:
Extortion of one or more cells of ANN does not prohibit it from generating
output, and this feature makes the network fault-tolerance.
Disadvantages of Artificial Neural Network:
▪Assurance of proper network structure:
There is no particular guideline for determining the structure of artificial neural
networks. The appropriate network structure is accomplished through
experience, trial, and error.
▪Unrecognized behavior of the network:
It is the most significant issue of ANN. When ANN produces a testing solution, it
does not provide insight concerning why and how. It decreases trust in the
network.
▪Hardware dependence:
Artificial neural networks need processors with parallel processing power, as per
their structure. Therefore, the realization of the equipment is dependent.
Disadvantages of Artificial Neural Network:

▪Difficulty of showing the issue to the network:

ANNs can work with numerical data. Problems must be converted into numerical
values before being introduced to ANN. The presentation mechanism to be
resolved here will directly impact the performance of the network. It relies on
the user's abilities.
▪The duration of the network is unknown:
The network is reduced to a specific value of the error, and this value does not
give us optimum results.
How do artificial neural networks
work?
▪Artificial Neural Network can be best represented as a weighted directed graph,
where the artificial neurons form the nodes.
▪The association between the neurons outputs and neuron inputs can be viewed
as the directed edges with weights.
▪The Artificial Neural Network receives the input signal from the external source
in the form of a pattern and image in the form of a vector.
▪These inputs are then mathematically assigned by the notations x(n) for every n
number of inputs.
 How do artificial neural networks
work?
▪Afterward, each of the input is multiplied by its corresponding weights ( these
weights are the details utilized by the artificial neural networks to solve a specific
problem ).
▪In general terms, these weights normally represent the strength of the
interconnection between neurons inside the artificial neural network. All the
weighted inputs are summarized inside the computing unit.
▪If the weighted sum is equal to zero, then bias is added to make the output
non-zero or something else to scale up to the system's response.
▪Bias has the same input, and weight equals to 1. Here the total of weighted inputs
can be in the range of 0 to positive infinity. Here, to keep the response in the
limits of the desired value, a certain maximum value is benchmarked, and the
total of weighted inputs is passed through the activation function.
How do artificial neural networks
work?
▪Finding the “optimal values of W — weights” that minimize prediction error is
critical to building a successful model. The “backpropagation algorithm” does
this by converting ANN into a learning algorithm by learning from mistakes.
▪The optimization approach uses a “gradient descent” technique to quantify
prediction errors.
▪To find the optimum value for W, small adjustments in W are tried, and the
impact on prediction errors is examined. Finally, those W values are chosen as
ideal since further W changes do not reduce mistakes.
Types of Artificial Neural Network:
There are various types of Artificial Neural Networks (ANN) depending upon the
human brain neuron and network functions, an artificial neural network
similarly performs tasks. The majority of the artificial neural networks will have
some similarities with a more complex biological partner and are very effective
at their expected tasks. For example, segmentation or classification.
Feedback ANN:
In this type of ANN, the output returns into the network to accomplish the
best-evolved results internally. As per the University of Massachusetts, Lowell
Centre for Atmospheric Research. The feedback networks feed information back
into itself and are well suited to solve optimization issues. The Internal system
error corrections utilize feedback ANNs.
Types of Artificial Neural Network:
Feed-Forward ANN:
A feed-forward network is a basic neural network comprising of an input layer,
an output layer, and at least one layer of a neuron. Through assessment of its
output by reviewing its input, the intensity of the network can be noticed based
on group behavior of the associated neurons, and the output is decided. The
primary advantage of this network is that it figures out how to evaluate and
recognize input patterns.
 Application of Artificial Neural
Networks
▪Image Processing and Character recognition:
▪ANNs play a significant part in picture and character recognition because of their capacity
to take in many inputs, process them, and infer hidden and complicated, non-linear
correlations. Character recognition, such as handwriting recognition, has many
applications in fraud detection (for example, bank fraud) and even national security
assessments.
▪Image recognition is a rapidly evolving discipline with several applications ranging from
social media facial identification to cancer detection in medicine to satellite image
processing for agricultural and defense purposes.
▪Deep neural networks, which form the core of “deep learning,” have now opened up all of
the new and transformative advances in computer vision, speech recognition, and natural
language processing – notable examples being self-driving vehicles, thanks to ANN
research.
Application of Artificial Neural
Networks
2. Forecasting:
Forecasting is widely used in everyday company decisions (sales, the financial
allocation between goods, and capacity utilization), economic and monetary
policy, finance, and the stock market. Forecasting issues are frequently complex;
for example, predicting stock prices is complicated with many underlying
variables (some known, some unseen).
Thank You!!