deep l earning

S.HELENE (ECE) & G.SRI SASI (BME)

Rajiv Gandhi College Of Engineering And Technology
Kirumampakkam,Puducherry.

ABSTRACT: Deep learning is an emerging area of machine learning (ML)

research. It comprises multiple hidden layers of artificial neural networks. The
deep learning methodology applies nonlinear transformations and model
abstractions of high level in large databases. The recent advancements in deep
learning architectures within numerous fields have already provided significant
contributions in artificial intelligence. This article presents a state of the art
survey on the contributions and the novel applications of deep learning. The
following review chronologically presents how and in what major applications
deep learning algorithms have been utilized. Furthermore, the superior and
beneficial of the deep learning methodology and its hierarchy in layers and
nonlinear operations are presented and compared with the more conventional
algorithms in the common applications. The state of the art survey further
provides a general overview on the novel concept and the ever-increasing
advantages and popularity of deep learning.

INTRODUCTION:

layer processing. In 2003, an interesting example was developed by applying particle filtering
and Bayesian – belief propagation. The main concept of this application proposes that a
human can recognize the face of a person by watching only a half – cropped face picture ,
therefore a computer could be able to reconstruct the image of a face from a cropped one.
Later in 2006, greed algorithm and hierarchy were combined into an application capable to
process handwritten digits. Recent researches have applied deep learning as the main tool for
digital image processing. For instance, applying a Convolutional Neural Networks (CNN) for
Iris Recognition can be more effective than using conventional iris sensors. CNN
effectiveness can reach up to 99.35 % of accuracy . Mobile location recognition nowadays
allows the user to know a determined address based on a picture. Artificial intelligence (AI)
as an intelligence exhibited by machines has been an effective approach to human learning
and reasoning . In 1950, “The Turing Test” was proposed as a satisfactory explanation of
how a computer could perform a human cognitive reasoning. As a research field, AI is
divided in more specific research subfields. For example: Natural Language Processing
(NLP) can enhance the writing experience in various applications [4,17]. The most classic
subdivision within NLP is machine translation, which is understood as the translation
between languages. Machine translation algorithms have resulted in various applications that
consider grammar structure as well as spelling mistakes. Moreover, a set of words and
vocabulary related to the main topic is automatically used as the main source when the
computer is suggesting changes to writer or editor. AI covers seven subfields of computer
sciences. Recently, machine learning and data mining have become the center of attention
and the most popular topics among research community. These combined fields of study
analyze multiple possibilities of characterization of databases . Through the years, databases
have been collected with statistical purposes. Statistical curves can describe past, and present
in order to predict future behaviors. Nevertheless, during the last decades only classic
techniques and algorithms have been used to process this data, whereas an optimization of
those algorithms could lead on an effective self–learning . A better decision making can be
implemented based on existing values, multiple criteria and statistics advanced methods.
Thus, one of the most important application of this optimization is medicine, where
symptoms, causes and medical solutions generate big databases that can be used to predict
better treatment.
Since ML covers a wide range of research, many approaches have been established.
Clustering, Bayesian Network, Deep Learning and Decision Tree Learning are only part of
the approaches. The following review mainly focuses on deep learning, its basic concepts,
past and nowadays applications in different fields. Additionally, it presents several figures
portraying the rapid development of deep learning research through publications over the
recent years in scientific databases.

BACKGROUND: The Deep Learning (DL) concept appeared for the first time in 2006 as
a new field of research within machine learning. It was first known as hierarchical learning at
the , Artificial Intelligence Natural Language Processing 1.- Machine Translation 2.-
Computer Interface Robotics 1.- Machine Vision 2.- Sensors 3.- Control Methods 4.- Robot
software Cognitive modeling Machine Learning Expert Systems Heuristic problem solving
Knowledge representation 1. Predicate calculus and mathematical logic 2. Semantic network
3. Semantic triples 4. Rule - based systems 5. Frames R. Vargas, A. Mosavi, L. Ruiz . and it
usually involved many research fields related to pattern recognition. Deep learning mainly
considers two key factors: nonlinear processing in multiple layers or stages and supervised or
unsupervised learning . Nonlinear processing in multiple layers refers to an algorithm where
the current layer takes the output of the previous layer as an input. Hierarchy is established
among layers to organize the importance of the data to be considered as useful or not. On the
other hand, supervised and unsupervised learning is related with the class target label, its
availability means a supervised system, whereas its absence means an unsupervised system.

APPLICATION: Deep learning implies an abstract layer analysis and hierarchical

methods. However, it can be utilized in numerous real life applications. As an example,
within digital image processing; gray scale image coloring from a picture used to be done
manually by users who had to choose each color based on their own judgment. Applying a
deep learning algorithm, coloring can be performed automatically by a computer . Similarly,
sound can be added into a mute drumming video by using Recurrent Neural Networks (RNN)
as part of the deep learning methods . Deep learning can be understood as a method to
improve results and optimize processing times in several computing processes. In the field of
natural language processing, deep learning methods have been applied for image caption
generation , and handwriting generation . The following applications are categorized in pure
digital image processing, medicine and biometrics.

IMAGE PROCESSING: Before deep learning officially appeared as a new research

approach, some applications had been carried out within the concept of pattern recognition
through A Supervised Semantics – Preserving Deep Hashing (SSPDH) algorithm has proved
a considerable improvement . (VHB) and Space – Saliency Fingerprint Selection (SSFS). The
accuracy of SSPDH is even 70% more efficient . Finally, another remarkable application in
digital image processing, using deep learning method, is facial recognition. Google,
Facebook and Microsoft have unique deep learning face recognition models . Lately,
identification based on a facial picture has changed to an automatic recognition by
establishing age and gender as initial parameters. Sighthound Inc. for instance tested a deep
convolutional neural network algorithm capable to recognize not only age and gender, but
even emotions . Furthermore, a robust system was developed to accurately determine the age
and gender of a person from a single image by the application of a deep multi-task learning
architecture .

MEDICINE: Digital image processing is undeniably an important part of the research

fields where a deep learning method can be applied. Thus, clinical applications have been
recently tested. For instance, a comparison between shallow learning and deep learning in
neural networks leaded to a better performance on disease prediction. An image taken from a
Magnetic Resonance Imaging (MRI) from a human brain was processed in order to predict a
possible Alzheimer disease . Although the early success of this procedure, some issues should
be considered for future applications. Training and dependency on high quality are some of
the limitations. Volume, quality and complexity of data are challenging aspects, however the
integration of heterogeneous data types is a potential aspect of deep learning architecture .
Optical Coherence Tomography (OCT) is another example where deep learning methods are
showing valuable results. Conventionally, images are treated by a manual development of
convolutional matrices . Unfortunately, the lack of training sets, limits the deep learning
method. Nevertheless within a few years, the introduction of better training sets will
effectively predict retinal pathologies and decrease OCT technology costs .

BIOMETRICS: In 2009, an automatic speech recognition application was carried out

to decrease the Phone Error Rate (PER) by using two different architectures of deep
belief networks . In 2012, CNN method was applied within the framework of a Hybrid
Neural Network - Hidden Markov Model (NN – HMM). As a result, a PER of 20.07 %
was achieved. The PER obtained is better in comparison with a 3 – layer neural
network baseline method previously applied . Smartphones and their camera resolution
have been tested on iris recognition. Using mobile phones developed by different
companies the iris recognition accuracy can reach up to 87% of effectiveness .
performed in this study clearly demonstrates the relevance of this technology and gives
a clearly illustrates the growth of deep learning and the tendency regarding for future
research in this field. Additionally, it is important to note that hierarchy of layers and
the supervision in learning are key factors to develop a successful application regarding
deep learning. Hierarchy is essential for appropriate data classification, whereas
supervision considers the importance of the database itself to be part of the process. The
main value of deep learning relies on the optimization of existing applications in
machine learning, due to its innovativeness on hierarchical layer processing. Deep
learning can deliver effective results on digital image processing and speech recognition.
The reduction on error percentage clearly corroborates the improvement compared
with existing and tested methods. During the current era and in a future, deep learning
can result into a useful security tool due to the facial recognition and speech recognition
combined. Besides this, digital image processing is a research field that can be applied
in multiple areas. For this reason and having proved a true optimization, deep learning
is a contemporary and exciting subject of advancement in artificial intelligent.

ADVANTAGES OF DEEP LEARNING: Deep learning has several advantages

over traditional machine learning methods, some of the main ones include:
1. Automatic feature learning: Deep learning algorithms can automatically
learn features from the data, which means that they don’t require the features to
be hand-engineered. This is particularly useful for tasks where the features are
difficult to define, such as image recognition.
2. Handling large and complex data: Deep learning algorithms can handle
large and complex datasets that would be difficult for traditional machine
learning algorithms to process. This makes it a useful tool for extracting insights
from big data.
3. Improved performance: Deep learning algorithms have been shown to
achieve state-of-the-art performance on a wide range of problems, including
image and speech recognition, natural language processing, and computer vision.
4. Handling non-linear relationships: Deep learning can uncover non-linear
relationships in data that would be difficult to detect through traditional methods.
5. Handling structured and unstructured data: Deep learning algorithms can
handle both structured and unstructured data such as images, text, and audio.
6. Predictive modeling: Deep learning can be used to make predictions about
future events or trends, which can help organizations plan for the future and
make strategic decisions.
7. Handling missing data: Deep learning algorithms can handle missing data
and still make predictions, which is useful in real-world applications where data
is often incomplete.

DISADVANTAGES OF DEEP LEARNING: While deep learning has many

advantages, there are also some disadvantages to consider:
1. High computational cost: Training deep learning models requires significant
computational resources, including powerful GPUs and large amounts of memory.
This can be costly and time-consuming.
2. Overfitting: Overfitting occurs when a model is trained too well on the training
data and performs poorly on new, unseen data. This is a common problem in deep
learning, especially with large neural networks, and can be caused by a lack of
data, a complex model, or a lack of regularization.
3. Lack of interpretability: Deep learning models, especially those with many
layers, can be complex and difficult to interpret. This can make it difficult to
understand how the model is making predictions and to identify any errors or
biases in the model.
4. Dependence on data quality: Deep learning algorithms rely on the quality of the
data they are trained on. If the data is noisy, incomplete, or biased, the model’s
performance will be negatively affected.
5. Data privacy and security concerns: As deep learning models often rely on large
amounts of data, there are concerns about data privacy and security. Misuse of data
by malicious actors can lead to serious consequences like identity theft, financial
loss and invasion of privacy.
6. Lack of domain expertise: Deep learning requires a good understanding of the
domain and the problem you are trying to solve. If the domain expertise is lacking,
it can be difficult to formulate the problem and select the appropriate algorithm.
7. Unforeseen consequences: Deep learning models can lead to unintended
consequences, for example, a biased model can discriminate against certain groups
of people, leading to ethical concerns.
8. Limited to the data its trained on: Deep learning models can only make
predictions based on the data it has been trained on. They may not be able to
generalize to new situations or contexts that were not represented in the training
data.
9. Black box models: some deep learning models are considered as “black-box”
models, as it is difficult to understand how the model is making predictions and
identifying the factors that influence the predictions.
while deep learning has many advantages, it also has some limitations, such as high
computational cost, overfitting, lack of interpretability, dependence on data quality,
data privacy and security concerns, lack of domain expertise, unforeseen
consequences, limited to the data it’s trained on and black-box models. It’s important
to consider these limitations when applying deep learning to a problem.
APPLICATION OF DEEP LEARNING:Deep learning has a wide range of
applications across multiple industries and fields. Some of the most common
applications include:
1. Computer vision: Deep learning is used in image and video recognition, object
detection, semantic segmentation, and other computer vision tasks. Applications
include self-driving cars, security cameras, and image recognition for mobile
devices.
2. Natural language processing: Deep learning is used in natural language
understanding, machine translation, sentiment analysis, and other natural language
processing tasks. Applications include chatbots, virtual assistants, and language-
based search engines.
3. Speech recognition: Deep learning is used in speech recognition, voice
identification, and voice synthesis. Applications include voice-controlled
assistants, voice-enabled devices and voice-controlled robots.
4. Predictive analytics: Deep learning is used to analyze historical data and make
predictions about future events. Applications include fraud detection, customer
churn prediction, and demand forecasting.
5. Recommender systems: Deep learning is used to analyze patterns in data to
recommend items to users. Applications include movie and music
recommendations, news recommendations, and product recommendations.
6. Healthcare: Deep learning is used to analyze medical images and patient data, to
improve diagnosis and treatment, and to identify potential health risks.
Applications include cancer diagnosis, drug discovery, and personalized medicine.
7. Finance: Deep learning is used to detect fraudulent transactions, to identify
potential risks, and to make predictions about stock prices. Applications include
credit fraud detection, algorithmic trading, and risk management.
8. Marketing: Deep learning is used to analyze customer data, to predict customer
behavior and to personalize marketing campaigns. Applications include customer
segmentation, customer lifetime value prediction, and personalization
9. Gaming: Deep learning is used to train agents to play games, and to develop
intelligent game-playing algorithms. Applications include game bots, game-
playing AI, and adaptive game design.
10. Robotics: Deep learning is used to enable robots to learn from experience and
adapt to their environment. Applications include autonomous vehicles, drones, and
industrial robots.
11. Cybersecurity: Deep learning is used to detect patterns in network traffic, and to
identify and respond to cyber threats. Applications include intrusion detection and
prevention, and malware detection.
These are just a few examples of the many ways in which deep learning is being used
today. The field is constantly evolving and new applications are being developed all
the time, as the technology and data availability .

CONCLUSION: Deep learning is indeed a fast growing application of machine

learning. The numerous applications described above prove its rapid development in
just few years. The usage of these algorithms in different fields shows its versatility.
The publication analysis performed in this study clearly demonstrates the relevance of
this technology and gives a clearly illustrates the growth of deep learning and the
tendency regarding for future research in this field.
Additionally, it is important to note that hierarchy of layers and the supervision in
learning are key factors to develop a successful application regarding deep learning.
Hierarchy is essential for appropriate data classification, whereas supervision
considers the importance of the database itself to be part of the process. The main
value of deep learning relies on the optimization of existing applications in machine
learning, due to its innovativeness on hierarchical layer processing.
Deep learning can deliver effective results on digital image processing and speech
recognition. The reduction on error percentage (10 to 20 %) clearly corroborates the
improvement compared with existing and tested methods. During the current era and
in a future, deep learning can result into a useful security tool due to the facial
recognition and speech recognition combined. Besides this, digital image processing is
a research field that can be applied in multiple areas. For this reason and having
proved a true optimization, deep learning is a contemporary and exciting subject of
advancement in artificial intelligence.
REFERENCE:
1. Abdel, O.: Applying convolutional neural networks concepts to hybrid NN-HMM model for speech
recognition. Acoustics, Speech and Signal Processing 7, 4277-4280 (2012).

2. Mosavi A., Varkonyi-Koczy A. R.: Integration of Machine Learning and Optimization for Robot
Learning. Advances in Intelligent Systems and Computing 519, 349-355 (2017).

3. Bannister, A.: Biometrics and AI: how FaceSentinel evolves 13 times faster thanks to deep
learning (2016).

4. Bengio, Y.: Learning deep architectures for AI. Foundations and trends in Machine Learning 2, 1-
127 (2009).

5. Mosavi, A., Varkonyi-Koczy, A. R., Fullsack, M.: Combination of Machine Learning and
Optimization for Automated Decision-Making. MCDM (2015).

6. Deng L, Yu D Deep learning: methods and applications. Foundations and Trends in Signal
Processing 7,197-387(2014).

7. Goel, B.: Developments in The Field of Natural Language Processing. International Journal of
Advanced Research in Computer Science 8, (2017).

8. Vaezipour, A.: Mosavi, A. Seigerroth, U.: Machine learning integrated optimization for decision
making, 26th Europian Conference on Operational Research, Rome (2013).

9. Hinton G E, Simon O, Yee-Whye T A fast learning algorithm for deep belief nets. Neural
computation 18, 1527-1554 (2006).

10. Hisham, A., Harin, S.: Deep Learning – the new kid in Artificial Intelligence. (2017).

11. Kim I W, Oh, M.: Deep learning: from chemoinformatics to precision medicine. Journal of
Pharmaceutical Investigation: 1-7 (2017) .

12. Mosavi, A., Vaezipour, A.: Developing Effective Tools for Predictive Analytics and Informed
Decisions. Technical Report. University of Tallinn (2013).