ABSTRACT

Communication for a person who cannot hear is visual, not auditory. Generally dumb
people use sign language for communication but they find difficulty in communicating
with others who don‟t understand sign language. So there is a barrier in communication
between these two communities. Smart Glove for Sign Language Translation is a work
that aims to provide a cost effective system which can give voice to voiceless person
with the help of Smart Gloves. This work consists of a glove equipped with sensors
which senses different sign language gesture, these senses data are fed to arduino UNO
and transfer data to android phone via Bluetooth module, a common android phone is
used in this work for sign to text and voice translation. In real life, the sign language
users mostly use both hands. Thus, this is a prototype work attempts to bridge the
communication gap between normal ones and the disabled by designing a portable glove
that captures the users gestures and outputs the translated text on a android phone. It
means that using smart gloves lowers the barrier in the means of communication.

v
 TABLE OF CONTENTS

CHAPTER NO. CHAPTER NAME PAGE NO.

ABSTRACT v
LIST OF FIGURES viii
LIST OF TABLES ix
LIST OF ABBREVIATIONS x

1 INTRODUCTION

1.1 Domain Description 01

1.2 Aim Of The Project 02

1.3 Outline Of The Project 02

1.4 Advantages 03

1.5 Disadvantages 03

1.6 Applications 04

2 LITERATURE SURVEY

2.1 Problem System 10

2.2 Existing System 10

2.3 Proposed System 11

3 METHODOLOGY

3.1 Requirements 12

3.1.1 Hardware Requirements 12

3.1.2 Software Requirements 12

3.2 Block diagram 13

vi
 3.2.1 Accelerometer 14

3.2.2 Arduino UNO 17

3.2.3 Bluetooth Module 18

3.2.4 Android Application 19

3.2.5 Android Studio 20

3.3 Working Principle

3.3.1 Flow Chart 28

3.3.2 Modules 31

4 RESULTS AND DISCUSSION

4.1 Application Login 32

4.2 Application Register 33

4.3 Smart Glove 34

4.4 Gesture and Output 35

5 CONCLUSION AND FUTURE WORK

5.1 Conclusion 36

5.2 Future Work 37

REFERENCES 38

APPENDIX

A. SOURCE CODE 40

B. SNAPSHOTS. 46

C. PUBLICATION 47

vii
 LIST OF FIGURES

FIGURE No. FIGURE NAME PAGE No.

3.1 Block Diagram of smart Glove 13

3.2 Accelerometer 14
3.3 Arduino UNO 16
3.4 Blue Tooth Module 17
3.5 Bluetooth App 21
3.6 Sensing the Gesture 27
3.7 Recognition of gesture 27
3.8 Final Result 28
3.9 Flowchart of glove 29
4.1 Blue tooth app login 28
4.2 Bluetooth app register 29
4.3 Smart Glove 34
4.4 Gesture and Output 35

viii
 LIST OF TABLES

TABLE No. TABLE NAME PAGE No.

2.1 Literature Survey 08

ix
 CHAPTER 1
INTRODUCTION

1.1 DOMAIN DESCRIPTION

The number of speech impaired and hearing impaired people are
increasing day by day. About 70 million people in the world are speech impaired
and hearing impaired. We often come across these people communicating with
the normal world. These people communicate with the help of sign language.
When a speech impaired person tries to communicate with normal person and
vice-versa, they feel difficult to understand. To bridge this gap, gesture recognition
system is being used. Gesture recognition is a widely explored field. A lot of work
has been done in the past few years. An electronic device has been used as a
language interpreter and provides convenient way for communication between
speech impaired, hearing impaired and normal people. Gesture recognition is
classified into two main categories i.e. image processing based and sensor based.
The main disadvantage of image processing based techniques includes complex
algorithms for data processing. Another challenge in image and video processing
includes variant lighting conditions, backgrounds and field of view constraints. The
sensor based technique offers greater mobility. Smart Glove for sign language
translation is our project which uses sensor based technique instead of image
processing based technique. First of all, sign language is converted to analog
voltage signal using five accelerometers. Using Arduino UNO the code dumped
into it is verified with the gesture recognized. Now, if the code matches to the
gesture it transmits the data through Bluetooth module to Android phone. An
application on android is used to display the characters received from Bluetooth
module in the form of text and voice. The number of speech impaired and hearing-
impaired people are increasing day by day. About 70 million people in the world
are speech impaired and hearing impaired. We often come across these people
communicating with the normal world. When a speech impaired person tries to
communicate with normal person and vice-versa, they feel difficult to understand.
To bridge the gap between them and normal masses, gesture recognition system
is being used. Gesture recognition is classified into two main categories i.e. image
processing based and sensor based. The sensor based technique offers greater
mobility than the image processing based.

1
1.2 AIM OF THE PROJECT

The main aim of the proposed project is to develop a cost effective system
which can give voice to voiceless person with the help of Smart Gloves. It means
that using Smart Glove by the disabled person enables them to communicate with
others which also helps to bridge the gap between person with disability and
normal person. Problems faced by the deaf person regarding employment can be
overcome by this method. So in the proposed work an intelligent microcontroller
based system using sensors will be developed which is able to:
 To develop code for the system when it receives its instruction from
gesture recognition system using accelerometer sensors.
 To develop a microcontroller based cost effective system to recognize
gesture and convert into coded form so that it can be displayed if code
matches with predefined codes.
 Normal person can text their message using keyboard.

The wireless arrangement makes the device more comfortable to be used

by the disabled person. Wireless transmission and reception of signals are done
with the help of RF transceiver.

1.3 OUTLINE OF THE PROJECT

 Smart glove is used for sign language translation using gesture recognition
which is useful for deaf and dumb people. This work consists of a glove
equipped with sensors that senses completely different language gestures.

 These sensors senses knowledge fed to Arduino UNO and

transfer knowledge to automaton phone via Bluetooth module.

 A typical automaton phone is employed during this work for sign to voice
and text translation. An android application is used for obtaining the results.

 Accelerometer sensor measures the linear movements of hand in X-axis

and outputs different values of X corresponding to the movement in X-axis.

 After sensing the gesture using 5 accelerometers all the data from sensors
are then processed on node MCU.

2
  For this, appropriate ranges are set for each alphabet and the words that
can be recognized with single hand based on the measured data obtained
from repeated measurements.

 A Bluetooth module is connected to Arduino UNO which displays the result

on android phone via Bluetooth.

1.4 ADVANTAGES
 Any complications in its user interface would inhibit the glove‟s use in everyday
life. The user can begin translation without much difficulty. Each translation can
be done without any unnecessary button-pressing or other interfacing.
 It has very few components and is cost effective. It is affordable by any kind of
person who needs it.
 For marketability purposes, the device shall be aesthetically pleasing and
easily wearable without any factors that hinder convenience during extended
periods of time. This includes a smooth, professional appearance without any
components that irritate, cut, bruise, or otherwise cause discomfort for the user.
 It is small in size hence, it is flexible to users. It is easy to operate and is a real
time translation.

1.5 DISADVANTAGES
 The main disadvantage is, as it uses Bluetooth module it ranges up to
100meters only.
 It is delicate as it has wired connections on it. Glove must be handled with
care without any loss of connections.

1.6 APPLICATIONS
 It can be used in hospitals that need several measurement systems which
can investigate physiological parameters of the patients.
 It can act as a communication aid for the hearing- and speech-impaired
persons.
 Using this we can control any electronic machines and devices wirelessly
by adding some others gestures and commands.
 This project can be also used as Signed Language Convertor/Interpreter.
 For gaming purposes like 3D gaming, at the place of joysticks.

3
 It can be used in military actions based on hand gestures, which can be
used for squad communication.
 The hand gesture recognition system can be used in robotics, desktop and
tablet PC applications and gaming.

4
 CHAPTER 2
LITERATURE SURVEY

Gesture based communication is utilized everywhere throughout the

world by the hearing-hindered and impaired to speak with each other and
whatever remains of the world. Communication via gestures is something
beyond moving fingers or hands; it is a reasonable and noticeable dialect in
which motions assume and vital part. These signs can be successfully utilized
the extent that correspondence with people is concerned yet regarding
correspondence with machines better philosophies and calculations must be
created. Individuals associate with each other to pass on their thoughts,
contemplations, and encounters to the general population around them. Yet,
this isn't the situation for hard of hearing quiet individuals. Gesture based
communication prepares for hard of hearing quiet individuals to convey.

Through gesture based communication, correspondence is feasible for

a hard of hearing quiet individual without the methods for sense of hearing
sounds. It aims to enhance a system for diagnosing the sign language,
Thereby creating a link between dumb people and normal people, and also
reduce the conveyance gap between them. Hand gesture plays an vital role
when compared to other gestures since it expresses the user's views in less
time In this paper to perceive the English letters in order a present work flex
sensor-based signal acknowledgment module is made.

K. Bairagi et al proposed a paper on Glove based gesture recognition

wherein a dumb individual can't talk like an ordinary individual. To have
correspondence between idiotic individuals and typical individuals, motion
correspondence is testing one. Picture preparing based systems are requiring
the camera to be before motion, which may not be conceivable constantly. To
reduce correspondence hole in the middle of stupid individuals and typical
individuals, hand gloves are outlined which can be effectively worn and worked
by the idiotic individual. The protection sensor and ADXL335 accelerometer
sensor are fitted close by gloves, which can without much of a stretch measure
the twist and development of hand motion of the client.

5
 These sign signs are changed over into a computerized flag utilizing
ADC. The microcontroller is utilized to acknowledgment hand motion. After
acknowledgment of motion, these signs are sent to the android telephone by
means of Bluetooth module. The got content flag at an Android is changed over
into discourse flag utilizing Text to Speech android application. The changed
over content to discourse yield is given the assistance of speaker framework
with the goal that it will be useful to ordinary individuals to comprehend sign
performed by the imbecilic individual. The LCD module is likewise used to show
perceived motion at microcontroller.[2]

Manisha U. Kakde1 , Amit M. Rawate2 , et al proposed a paper in

which the gesture based communication is a strategy of correspondence for
hearing hindered - quiet individuals. The proposed framework is planned in
genuine time mode to perceive 9 signals from gesture based communication
utilizing MATLAB. Signs are caught through web camera and YCbCr shading
change show utilized for highlight extraction. PCA calculation is utilized to
perceive sign. PCA thought about element of caught picture with preparing
database and to ascertain least Euclidian separation. At long last perceived
yield is changed over into content and discourse. this framework takes out
correspondence boundary between hearing disabled quiet and ordinary
individuals.[3]

TITLE: SMART GLOVE FOR DISABLE PEOPLE

AUTHORS: Abhay, L.Dhawal, S.Harshal, A.Praful, P.Parmeshwar

YEAR: 2018
DESCRIPTION:
A different method had been developed by Archana S Ghotkar, Rucha
Khatal, Sanjana Khupase, Surbhi Asati and Mithila Hadop through Hand Gesture
Recognition for Indian Sign Language consisted of use of Cam shift and HSV
model and then recognizing gesture through Genetic Algorithm, in the following
applying cam shift and HSV model was difficult because making it compatible with
different MATLAB versions was not easy and genetic algorithm takes huge