Design and Implementation of Voice Based Email System For Blind People
Design and Implementation of Voice Based Email System For Blind People
INTRODUCTION
According to Ingle, Kanade and Lanke (2016) internet is currently the basic means of
communication in the world and one of the oldest form of communication through the internet is the
use of electronic mails or emails for short. Email is a computer-based communication system where
messages can be written by a sender on a computer. These messages are then transmitted via
computers to the addressee’s mail server where they can be opened and read by the receiver.
Kumari, Pai and Nayak (2017) stated that originally these messages could contain only text, but
nowadays anything that is storable on a computer can be transmitted via email messages. In this
thesis, messages that contain other information than text are considered as email messages with
attachments. These attachments are normally files created with other programs (e.g. FrameMaker,
Word, and Excel) than the email program. There are email systems that can handle information such
as pictures, sound, and video without assistance from other applications, but this is not important for
this thesis.
According to Russell and Norvig (2019) Email is distinguished from communication services such
as chat or talk by its asynchronous character. Asynchronous refers to the possibilities for the sender
and the receiver of a message to send and read the message at different times. This time difference
according to Fink (2010) is divided into three parts: the time between message creation and the time
of transmission (allowing the sender to edit the message), the time between the transmission and the
receiver’s opening of the message, and finally the time between opening and the responding to the
message.
1
Nowadays people rely on communication, be it using instant messengers, social networks or email.
Communication helps us maintain relationships, do business and spread news. With the availability
of computers, cell phones, and an internet connection, communicating has become unbelievably
easy. All this convenience can only be enjoyed by people who are not blind or people without
crippled hands. They too deserve to be part of this new age or at least a part of it since science can
only do so much to help people with disabilities. The fact that disabled people cannot always enjoy
all that can be enjoyed by a person with no disabilities is understood, but society must put in an
effort for these people to at least enjoy all they can. Hence, this project is geared towards
developing a voice-based email system to help blind or visually impaired people to be able to access
There are technologies like screen readers and braille keyboards available. They aim to make the
personal computer or cell phone accessible to the visually impaired. Unfortunately, these do not
meet all the requirements for the visually impaired because there are various problems which
associated with them. For instance, most available text-to-speech mobile software are not dedicated
to email services. Cell phone calling has remained the most accessible communication technology
available to the visually impaired. The use of screen readers mostly requires a user to first have a
window open, then the text is read out. This also makes use of devices that aren’t accessible to the
visually impaired. Blind people have no privacy when trying to communicate with someone far
away, except for voice calling, there are no much options of digitally communicating with the blind.
You cannot use email, instant messengers or SMS because all these are not accessible to the visually
impaired without them having help from a normal person. Also, not all blind people understand
braille, thereby making voice the primary source of input, which isn’t fully supported with existing
systems.
2
1.3 Aim and Objectives of the Project
The aim of this project is to develop an android application that can improve the means with which
the visually impaired read the content of emails received. This is achieved by developing a voice
based email system that the visually impaired can use with little or no assistance.
vi. To send email message as an attached voice note if the voice cannot be converted to text
The scope of this research work involves creating a mobile app that will be perfectly accessible to
all types of users as it is based on the android OS which is one of the most used mobile devices
platforms these days. Also because of IVR facility those who cannot read need not worry as they
can listen to the prompting done by the system and perform respective actions.
The significance of this project work is to serve as a helping tool for the vision impaired/blind users.
Blind users will be able to use the software to listen to the content of the emails sent to their phone.
The application will convert text to speech and prompt the user to take necessary actions.
3
1.6 Definition of Terms
Electrical Aided: An electronic device that help particular disable been to achieve a setting goal
4
CHAPTER TWO
LITERATURE REVIEW
Literature reviews are designed to provide an overview of sources you have explored while
researching a particular topic and to demonstrate how research fits within a larger field of study. As
such, this chapter is a comparison between E-mail systems that exist and an E-mail system that this
project proposed. In the context of visually impaired persons, different E-mailing systems will be
reviewed so as to determine their benefits and drawbacks. After that, one can now clearly see where
there is a need for improvement and where development can fork from. Also, there is an outline of
the foreknowledge of the proposed system and the source of that knowledge.
Abner and Lahm (2012) in their study “Implementation of assistive technology with students
who are visually impaired: teachers' readiness” found that the estimation of 285 million people
suffering from visually impairment worldwide are divided into two groups of 39 million blind and
246 million with low vision. That means that someone in our world goes blind in every five seconds.
Demographics of the blindness vary significantly in different parts of the world. Arter (2007) carried
out a study on “Visual impairment: access to education for children and young people”, he
found out that in developing countries, about 0.4 % of the population is blind while in the rest part
of the world this rate rises up to 1 %. Chong (2013) observed that consequently, 90 % of the visually
impaired population are living in developing countries. About 82 % of the blind are over the age of
50.
5
(a) Normal vision
Figure 2.1: Four examples of different kind of vision and visual impairment
Arter (2007) further stated that it is important to distinguish between different kind of visually
impairment, as each type are causing different problems which requires different kind of solutions
and contextual information necessary. In figure 2.1 it is shown some different kind of visual
impairment and how it can affect the visual information available compared to normal vision. There
are also several different degrees of visual impairment and according to WHO (2019), vision
Blindness
Moderate vision impairment combined with severe vision impairment are grouped under the term
“low vision”: low vision taken together with blindness represents all vision impairment. About 15 %
6
of people who are having vision loss cannot see anything at all. According to Kumari et al., (2017)
in their study on “Voice-based E-mail system for blinds” the remaining 85-90 % may have
residual vision or other types of low vision and may have difficulties with colour, light, form or
movement perception.
Tuttle (2004) stated that although persons who are blind do not yet enjoy the same full and equal
status accorded most other members of society, there have been remarkable changes, particularly in
Lowenfeld (1975) identified the following four phases in society's treatment of persons who are
blind:
Separation
Ward status
Self- emancipation
Integration
Separation
In many primitive societies and during early historical times, prompted by the prevailing
unchallenged assumption that persons who were blind could not contribute to the welfare of the
community, most people who were blind were ostracised from society. The cruel behaviour towards
people who were blind was rationalised, as they were not regarded as people, but rather as objects
who posed a threat to the survival of the society. On the other hand, there were some people, who,
7
In the earliest cultures, persons who were blind were rarely permitted to live a normal lifespan, or to
contribute to the wellbeing of the family or tribal unit. However, Dobree & Boulter (2002) observed
that as new cultures and civilisations emerged and gained ascendancy, this attitude changed
gradually, so that fear was mixed with pity, and rejection with compassion.
According to Lowenfeld (1975) Historical records of many different civilisations reveal the
presence of beggars who were blind, indicating that people of the day were willing to give food and
With regard to the situation in Ancient Greece and Rome, beggars who were blind were restricted to
specific areas, for example, the gates of the cities, the steps of the temples, and around civic
buildings. Many people, including great leaders, were convinced that nothing was gained by keeping
alive those who were blind. In fact, the citizens of Rome were exhorted to refrain from providing
food and drink to beggars who were blind, believing that their actions would be a double evil.
Dobree & Boulter (2002) stated that firstly, that which was given would be lost to the donor, and
secondly, it would unnecessarily extend the life of misery being endured by the recipient.
Lowenfeld (1975) in a historical study found that the two Greek philosophers, namely Plato and
Aristotle, gave their support to the practice of putting to death imperfect infants, including those
Dobree & Boulter (2002) also discovered that in Sparta and Athens, formal rituals were held to
determine whether the degree of disability in a young child was sufficient to justify his/her death.
However, it was generally ruled that those who were blind should be put to death.
According to Koestler (2016) the practice of ending the lives of physically disabled babies was
prevalent in Rome. Small reed baskets were sold in which infants who were blind or infirm were
8
placed prior to being cast into the river Tiber. In Thebes, many infants were killed, and those whose
Protection
According to Dobree & Boulter (2002) Although many centuries were to pass before the mass of
persons who were blind could derive direct benefit from planned services for their education and
welfare, they came at least to enjoy the right to life, the receipt of alms, and, in isolated instances,
According to Kirtley (2015) the ideal of individual human worth first emerged in the Orient. In both
China and India, useful occupations for persons who were blind were found relatively soon.
Dobree & Boulter (2002) stated that based largely on a philosophical approach, in early China, it
was recognised that blindness freed the sightless from the distractions of everyday life, enabling
their minds to ponder the mysteries of the world. Some gained enviable reputations as soothsayers,
being sought out by many in high office. Music, which was closely associated with blindness and
with the individual lives of people who were blind, was recognised as being a unique outlet for their
talents. Early Chinese writings contain references to the blind men who, with songs and gongs,
travelled the land bringing enjoyment to their listeners while making their contribution to the growth
of public awareness of the abilities that were latent in those without sight.
Kirtley (2015) stated that with regard to the situation in India, Buddhism encouraged compassion for
persons with disabilities. During the third century B.C. the pious, Asoka the Great, constructed
hospitals at public expense and encouraged tolerance toward both the impoverished and persons
with disabilities. Moreover, some of the people who were blind gained a respectable niche in society
as transmitters of oral tradition, both secular and religious. They memorised the stories of past
9
events and travelled the countryside reciting the histories and fables of bygone ages. However,
Dobree & Boulter (2002) stated that in Japan, some persons who were blind were welcome guests at
the courts of the mighty, where they recited from memory stories and records from the annals of the
past.
Tuttle (2004) found that during the Judaic and early Christian periods, pity and compassion for
persons who were blind emerged as dominant patterns. Recognition of persons who were blind as
members of the human race brought with it the responsibility to care for one's brother. This care and
concern found expression in the establishment of asylums or sheltered environments where the basic
needs, such as food, clothing, and housing were met. Although persons who were blind were
recognised as members of society, they were still not perceived as capable of any meaningful
contribution. The dignity and worth of persons who were blind remained in doubt, resulting in their
According to French (2004), in the early Christian communities, children, the aged, and those who
were blind were the special wards of the Church. In particular, the deacons took special care of
persons who were blind, and wealthy Christians took persons who were blind into their households
During and after the fourth century, asylums and hospitals were founded, which also provided
accommodation for persons who were blind. However, there is no doubt that most persons who were
blind were left to a beggar's lot, relying upon the good deeds of individuals and upon alms from the
Church.
According to Kirtley (2015), in early Islamic countries, the state of persons who were blind was
somewhat more satisfactory than in Europe. During the eleventh century, they were offered
10
instruction at Cairo's University of AI-Azhar. Their education extended over a twelve- year period
and was accomplished through memorisation. Some persons who were blind became teachers or
preached in the mosques, while many others sang or recited the Koran in public and holy places.
Egypt was one of the first countries to produce self- supporting scholars who were blind.
For persons who were blind in the Middle Ages, the situation was very different. With the spread of
Christianity, particularly across Europe, the practice of offering charity to all who were in need,
Lowenfeld (2015) stated that while limited efforts were made to provide for the educational training
of those persons who were blind, the provision of food and shelter, clothing, and other basic
necessities of life became common practice, culminating in Paris in 1254 with the establishment of
Hospital des Quinze Vingts by Louis IX. This was a special residential home for 300 persons who
were blind (thus the name - fifteen times twenty) drawn from the streets of Paris and elsewhere in
Kirtley (2015) observed that although admission to the Quinze-Vingts was initially restricted to men
who were blind, this was later extended to women as well. "Each brother and sister joined with all
personal belongings, which, at death, became the property of the asylum. They were obliged to keep
the statutes and secrets of the House, observe certain religious rituals, and execute all allocated
chores. In addition, they wore the House uniform - a long blue gown with a lily on the breast".
To keep the members of the Quinze-Vingts gainfully occupied, some effort was made to provide a
modicum of instruction and training in simple crafts. A number of blind thinkers of the day, freed
from the constant battle for physical survival, added the fruits of their talents to the growing
reservoir of positive contributions being made to thought and life in the communities in which they
lived. Dobree & Boulter (2002) observed that for the most part, however, the residents of the
11
Quinze-Vingts continued their former lives as beggars, but with the advantage that they did not have
While the purposes for which it was established and the results achieved by the Quinze-Vingts at the
time of its establishment were elementary by today's standards, it was outstandingly important in the
long history of service to people who were blind, and the growth of understanding about blindness,
being the first recorded case of acceptance by the State of responsibility for the care and support of
persons who were blind. It was, therefore, the forerunner of many similar enterprises later to
develop in Europe and elsewhere. (Lowenfeld (2015) stated that these brotherhoods, such as those in
Italy, Spain and Germany, were connected with specific churches and were under the patronage of
various saints.
Self- Emancipation
According to French (2004), although very little was done to make persons who were blind self-
supporting, it remained for persons who were blind themselves to point the way toward the form
which that care should take, by showing in their persons and achievements that their greatest need
was that of education. Therefore, throughout history, there have been stories told about remarkable
and talented persons who were blind, who managed, often with insightful assistance, to educate
themselves and to make significant contributions to their societies. Roberts (2016) stated that these
persons, through their own efforts, rose to prominence, despite the prevailing attitudes to blindness
E-mail, short for electronic mail, is a method of exchanging messages ("mail") between people using
electronic devices. Invented by Ray Tomlinson, E-mail first entered limited use in the 1960s and by
the mid-1970s had taken the form now recognized as E-mail. E-mail operates across computer
12
networks, which today is primarily the Internet. Some early E-mail systems required the author and
the recipient to both be online at the same time, in common with instant messaging. Today's E-mail
Today, there are more than four billion E-mail accounts and more than two and a half billion E-mail
users (THE RADICATI GROUP, INC., 2019). This makes E-mail the most spread communication
technology on the internet. This staggering statistic is because E-mail is universal. One can do
Only a handful of websites and applications target the visually impaired. A survey by World Health
Organization (2018) shows that there are more than 250 million visually challenged people around
the globe. That is, around 250 million people are unaware of how to use the internet or E-mail. The
only way by which a visually impaired person can send an E-mail is by having to dictate the entire
content of the mail to a third person (not visually challenged) and then the third person will compose
the mail and send on the behalf of the visually impaired person.
But this is not a correct way to deal with this problem. It is very less likely that every time a visually
challenged person can find someone for help. What most of these websites and applications fail to
produce is a system that is fully supported by voice alone, a system that completely eliminates the
use of a keyboard, mouse or another form of pointing device, not to mention assistance from another
person.
Examples of traditional E-mail clients in use are Gmail, Outlook, Yahoo Mail etcetera. Most
facilities available on the majority of the E-mail client software require visual perception. Some
software tries to cater to the visually impaired. Consider Gmail, the most popular E-mail client, it
13
has a platform that tries to make E-mail accessible to the visually impaired. The two facilities
provided that are worth noting are a Screen Reader and Keyboard shortcuts.
Drawbacks
The very fact that this software requires visual perception is a major drawback. Using a screen
reader requires a user to first open a page or window. That alone requires visual perception. The
screen reader software then reads out the page or window content in a sequential manner and
therefore the user can make out the contents of the screen only if they are in basic HTML format.
Thus the new advanced web pages which do not follow this paradigm in order to make the website
more user-friendly only create extra hassles for the visually impaired people. Also, users have to
remember keyboard shortcuts which make the software not user-friendly. Messages are composed
using the keyboard and again, this requires visual perception that the visually impaired lack.
Pranjal Ingle et al proposed and developed an E-mail system that the visually impaired can use.
According to their paper, the system uses Interactive Voice Responses (IVR), Speech to Text
conversion (STT) and Text to Speech conversion (TTS). The user interacts with the system by using
mouse clicks as described in their paper. Ingle, Kanade and Lanke (2016) stated that “User will be
very well guided with the help of voice commands, while registration all the necessary fields to be
filled will be read by site, by clicking on that box he would have to fill in them. For example, if the
cursor moves over register icon it would sound ‘register button’, after clicking on the register button
Kumari et al, (2017) also wrote a paper with the same title as Pranjal Ingle et al. Their systems are
somewhat identical. Both use voice and mouse clicks as input sources. Also, the two systems
Figure 2.2 System Architecture for E-mail for the visually impaired
Drawbacks
The major drawback of the Voice-based E-mail system for the blinds is that the systems rely on
mouse click events, which require visual perception for them to be executed. This alone is the whole
basis for building this software project. TTS and STT conversions are done locally by the user
device which results in a poor performance application because a lot of time is done processing the
text to speech and vice versa. The software is only available on the Desktop platform. Desktops and
laptops are more expensive and less accessible than mobile devices.
15
2.2 Theoretical Framework
The presence of a visual impairment can impact the normal sequence of learning in social, motor,
language and cognitive developmental areas. Reduced vision often results in a low motivation to
explore the environment, initiate social interaction, and manipulate objects (Project Ideal).
According to Project Ideal, people with visual impairments must be taught compensatory skills and
adaptive techniques in order to be able to acquire knowledge from methods other than sight. The
people with Visual Impairment have limited ability to explore the environment, often need to rely on
other senses to gather information, hence cannot share common visual experiences with their sighted
peers, and therefore vision loss may negatively impact the development of appropriate social skills.
Perez-Pereira and Conti-Ramsden (1999) stated that as a result, these people may experience low
self-esteem that limits their sense of mastery over their own lives. This calls for providing them a
According to Torreno (2012) social deficits in people with visual impairment are typically caused by
a lack of information about the visual aspects of interacting with others. Hence it is important to find
out how visually impaired people socialize, what are their strengths and weaknesses regarding social
skills and how to improve their socialization for their inclusion in information technology.
Theoretical foundation
If we want to establish inclusion as a new paradigm and thus training visually impaired for
theories. For this purpose, different theories are analyzed by considering three major areas viz.
disability, socialization- social skills development and inclusion and the related conceptual
16
Figure 2.3 Areas of Research
The theoretical framework is formulated to explain, predict and understand various interrelated
aspects of the phenomena and help to connect the existing knowledge in the related areas and to
support in prescribing future solutions. These theories are presented according to the major areas
Inclusion is a broad concept and many theories are considered which explains the nature and role of
inclusion in education. Social Inclusion (Scottish Human Services Trust, 2005) is based on the
values as - Everyone is ready, everyone can learn, everyone needs support, everyone can
communicate, everyone can contribute, and together we are better. It states that difference is our
most important renewable resource. Social inclusion theory by Peter Rodney, (2003) explains that
the basic didactic and psychological belief underlying inclusive education is that there is no
difference between the educational needs of the child with a disability and the other children. They
have one common goal: social inclusion. These theories thus are based on the social inclusion
strategy, important to facilitate better life outcomes through better social engagement of individuals
According to the theory of Radical democracy (Halprin D., 1999), a particular form of democratic
17
achieve the long-term goal that all students, upon completion of secondary schooling are capable of
fulfilling the requirements of an informed, active and responsible democratic citizen. This theory
thus supports that inclusion is important to prepare disabled students to become capable and
responsible citizens. Hence certain measures are needed for preparing disabled students for their
democratic inclusion.
Further the Social exclusion theory by Hilary Silver (2007) stated that Social exclusion is a
multidimensional process of progressive social rupture, detaching groups and individuals from
social relations and institutions and preventing them from full participation in the normal,
normatively prescribed activities of the society in which they live. This theory is thus helpful to
know that if we want to integrate the disabled students in the mainstream social inclusion is
necessary. Social exclusion can be avoided by improving the participation of the disabled. Social
exclusion results in a social isolation and thus become a barrier in mainstreaming of the disabled
students. According to Harry & Margaret Harlow, (1949) in their Theory of Social Isolation, as
discussed in the Fifth Canadian Edition of Sociology, extreme social isolation results in irreversible
students for social skills improvement to lead a normal life and avoid their social exclusion.
Peter Rodney in his theory of social inclusion, stated the relatedness of blindness and personality
and explained that psychologically, blindness does not limit the mental processes. It is emphasized
that, efforts to train the blind person's sense of hearing have their limitations, the same is not true of
the mental and social development. Thus training visually impaired students for inclusive settings by
developing their social skills will help them in developing their personality.
According to Theory of defectology by Lev Vygotsky, (1993), the psychological aspect of visual
impairment in the development of inclusion corresponds more or less to the current concept of
18
special needs education (SNE). Any physical handicap not only alters the child's relationship with
the world, but above all affects his interaction with people. Any organic defect is revealed as a social
abnormality in behavior. Thus it is clear that socialization and inclusion override the physical
impairment and, makes the term ‘defect’ incomprehensible. Thus visually impaired students if
trained properly may improve in their social skills and thus lead a normal life which can be
explained with the concept of Compensatory Education Development (Garbner, 1988). The focus
through acquiring basic and life skills needed to function successfully in daily living. Compensatory
education is provided to help disadvantaged students to overcome any cognitive and social deficits
From the above discussion it is clear that all these theories support the need of socialization for the
visually impaired students for inclusion. The term socialization has been approached in a number of
ways. Various theories are studied to understand the interrelated components of socialization. Social
Development Theory (Lev Vygotsky, 1978) argues that social interaction precedes development;
consciousness and cognition are the end product of socialization and social behavior. A second
aspect of Vygotsky's theory is the idea that the potential for cognitive development depends upon
the "zone of proximal development" (ZPD): a level of development attained when children engage
in social behavior. Full development of the ZPD depends upon full social interaction. The range of
skill that can be developed with adult guidance or peer collaboration exceeds what can be attained
alone. In other words it can be said that social interaction improves socialization. Further Vygotsky
added that disability will change during development and that it is sensitive to the influence of
remediation programs and social influences. Through his Socio-cultural theory, Vygotsky (1995)
introduced the core concepts of the "primary disability, "secondary disability" and their interactions.
19
refers to distortions of higher psychological functions due to social factors. An organic impairment
prevents a child from mastering some or most social skills and acquiring knowledge at a proper rate
and in an acceptable form. He stated, if the path of development diverges from normal social
development because of the child’s disability, then the child is socially deprived. This leads to the
emergence of delays and deficiencies, i.e. secondary handicapping conditions and inadequate
compensatory ways of coping. Thus it is clear that socially deprived child develop delays and
Theory of Social Behaviorism by George Herbert Mead (1967) explained that people develop self-
images through interactions with other people, a person’s personality consisting of self-awareness
and self-image, is a product of social experience. The self develops solely through social experience.
The planned and organized experiences lead to develop person’s self-image and lead to improve
their socialization. Charles Cooley through the Development of self, explained that the heart of
socialization is the development of the self. It further suggests that the mark of successful
socialization is the transformation of social control into self-control. (Spark Notes Editors, 2006). It
shows that the development of self and identity in the context of intimate and reciprocal relations is
In addition to the above concepts George Herbert Mead through the concept of Self-socialization
stated that the sense of self is developed through social interaction. The self is a changing but
enduring aspect of personality that is a collection of beliefs that one hold about oneself. An
individual formulate his beliefs based upon his social interactions with others. (SparkNotes Editors,
2006). It indicates that through improved social interactions, self can be developed.
Bandura Albert, (1977) in his Social learning theory explained that people learn new behavior
through overt reinforcement or punishment, or via observational learning of the social factors in
20
their environment. People can learn through observation - observational learning can occur in
relation to three models: Live model – in which an actual person is demonstrating the desired
behavior. Verbal instruction – in which an individual describes the desired behaviour in detail, and
instructs the participant in how to engage in the behavior and Symbolic – in which modeling occurs
by means of the media, including movies, television, Internet, literature, and radio. This type of
For the Interactionists, society consists of organized and patterned interactions among individuals.
The interactionist theorist sees humans as active, creative participants who construct their social
George Herbert Mead and Herbert Blumer put forward the perspective that people act toward things
based on the meaning those things have for them; and these meanings are derived from social
interaction and modified through interpretation. (Griffin, Emory A. 2006). Further it states that -
Social interaction through organized and patterned programme make children active in their social
world.
Erving Goffman created the concept of total institution in his essay “On the Characteristics of Total
Institutions” published in 1961 in Asylums. Total institutions are social hybrids, part residential
community and part formal organization intended for the bureaucratic management of large groups
of people. Goffman (1961) offers this definition: A total institution may be defined as a place of
residence and work where a large number of like-situated individuals, cut off from the wider society
for an appreciable period of time, together lead an enclosed, formally administered round of life
where Resocialization is stated as a process of tearing down and rebuilding an individual’s role and
intervention. Thus Resocialization through social skills development programme may help visually
Moreover there are two different aspects of socialization, cognitive (Jean Piaget) and psychosocial
Thus it is clear that Socialization program may be helpful to change children’s thought process that
may improve their interaction with the world as skill assimilation and accommodation is an ongoing
children socialize and how this affects their sense of self. According to this theory, successful
completion of each developmental stage results in a healthy personality and successful interactions
with others. Thus it confirms the need of Social skills improvement for socialization and thus sense
of self.
As discussed earlier social rules and relations are created, communicated and changed in verbal and
non-verbal ways. The process of learning such skills is called socialization. Social skill is any skill
facilitating interaction and communication with others. Thus to improve socialization social skills
are needed to be developed. A Social skill development programme can be designed to satisfy this
purpose. There are various theories that explain the skill development and social skill development
specifically.
According to Skill acquisition Theory, Crossman (1959) provided an early view on how practice
leads to performance improvements. Crossman’s model qualifies as a theory that proposes, practice
leads to more efficient procedures for performing a task. While Dreyfus and Dreyfus in their Skill
development theory explained that, as human beings acquire a skill through instruction and
22
experiences, they do not appear to leap suddenly from rule-guided “knowing that” to experience-
based “knowing-how.” Hubert and Stuart Dreyfus Dreyfus Model of Skill Acquisition postulates
that, when individuals acquire a skill through external instruction, they normally pass through five
stages: Novice, Advanced Beginner, Competent, Proficient, and Expert. According to Hall-Ellis and
Deborah (2013) progression through the five stages is viewed as a gradual transition from rigid
adherence to rules to an intuitive mode of reasoning believe that there is a gradual process involved
for an agent to go through in order for him to reach the stage of expertise or knowing-how.
Transfer of learning - Identical Element Theory by Edward Thorndike also explains Skill to skill
transfer. Transfer of learning occurs when learning in one context or with one set of materials
impacts on performance in another context or with other related materials. Perkins and Solomon
(1992) stated that if the influence is on a new skill being developed then this is said to be proactive
and if the influence is on a previously learned skill then this is said to be retroactive so skill
development is based on the concept of transfer of learning. Education can achieve abundant
Similarly according to Transformational learning by Jack Mezirow (1990) the process of learning,
analyzing and making deliberate changes to the assumptions that we have, cause us to think act and
learning focuses on achieving coherence rather than on exercising more effective control over the
critique of the assertion itself. It also requires a critique of the relevant social norms and of cultural
codes that determine the allocation of influence and power over whose interpretations are
acceptable. This discussion shows that Social skills can be taught to visually impaired through
experiences and instructions to improve their performance, assertion and ultimately socialization.
23
Dr. Dame Lilli Nielsen believes that all very young children learn by being active, rather than
passive recipients of stimulation. A visual impairment prohibits a child from having enough
opportunities to develop these abilities and have these experiences without intervention. She
encourages the adults to set up the child's environment so that he can do this. Active Learning
explains that the immediate repetition enables the child to store the information gained from the
experiences in his memory. Thus Activity based program should be considered while designing the
intervention to help visually impaired students to learn social skills. (Shafer Stacy, 1995).
Sequential learning by Fitts and Posner (1967) explained that there are three stages to learning a
new skill: Cognitive phase - Identification and development of the component parts of the skill -
involves formation of a mental picture of the skill. Associative phase - Linking the component parts
into a smooth action - involves practicing the skill and using feedback to perfect the skill and
Autonomous phase - Developing the learned skill so that it becomes automatic - involves little or no
conscious thought or attention whilst performing the skill - not all performers reach this stage. The
component, using feedback. Rehearsal of the skill must be done regularly and correctly.
The Structured-Discovery Learning by Dr. James S. Nyman (2001) suggests two approaches to
provide training to blind people – The science model: The counselor need only take charge of the
individual's behavior and with patience and skill effect the equivalent of a cure. It is not necessary
for the student to know the science behind the training, only to execute the acquired skills to a
prescribed standard. The philosophy model: Most of the environmental knowledge is derived from
techniques for accessing relevant information. This is the foundation of the philosophical approach
known as structured-discovery learning. This supports that the visually impaired children can be
24
trained by monitoring their behavior and giving them experiences to develop alternative techniques
This chapter reviewed several literatures on the proposed voice based email system for blind people.
The information gathered shows that the system will be beneficial for society by allowing disable
people also to grow along with society. The reviewed literatures suggests that voice based email
makes visually challenged people able enough to be part of the growing digital world by allowing
them to communicate via internet and also making life of such people much easier. This system
overcomes many drawbacks that were faced by visually challenged people such as sending and
receiving emails. Success of this project can make an impact on developers motivating them to
make something useful that can help visually challenged or blind people.
25
CHAPTER THREE
This is a description of methods chosen to achieve the objectives of the proposed system. It will go
on to describe the techniques of data collection that will be employed in the research study of the
proposed systems.
3.1 Materials
Android Studio: Android Studio is integrated development environment for Google’s android
operating system. Its task is to provide the interface for producing applications and to handle much
of the intricate file management. The programming language used for this is Java. It grants you
access to the android’s SDK (software development kit). SDK is the addition to the java code that
grants to run effortlessly on android devices. Android Studio allows you to run your code either via
an emulator or via a piece of hardware connected to your machine. Android Studio will present a list
of auto-complete suggestions. Some of its features are gradle based built support, android specific
renaming and prompt fixes, it supports building of android wear applications and it contains an
Android Virtual Device(Emulator) which helps to run and debug its applications.
configuration, transactional SQL database engine. It is the standard database provided by Android.
Java Mail API: The Java Mail API contributes a platform- self-sufficient and protocol self-
sufficient framework to construct mail and messaging applications. The Java Mail API provides a
set of undefined classes defining objects that encloses a mail system. Some of the JavaMail API
26
3.2 Method
To achieve the development of the proposed system the prototype methodology adopted for the
software development. The prototype methodology is the software development process which
allows developers to create only the prototype of the solution to demonstrate its functionality to the
clients and make necessary, modifications before developing the actual application.
In this phase, the requirements of the system are defined in detail. The users of the system were
The second phase is a preliminary design or a quick design. In this stage, a simple design of the
system was created. The quick design helps in developing the prototype.
In this phase, an actual prototype was designed based on the information gathered from quick
design.
In this stage, the proposed system was presented to the client for an initial evaluation. It helps to find
out the strength and weakness of the working model. Comment and suggestion were collected from
This phase will not be over until all the requirements specified by the user are met. Once the user is
satisfied with the developed prototype, a final system is developed based on the approved final
prototype.
Once the final system is developed based on the final prototype, it was thoroughly tested and
deployed to production. The system undergoes routine maintenance for minimizing downtime and
Starting with the traditional mail systems i.e. Gmail, the platforms rarely try to cater for the visually
impaired persons. Only two implementation options were built. Namely keyboard shortcuts and a
screen reader. Needless to say, keyboard use requires visual perception, therefore, that becomes a
major weakness of the tradition mail software. In regards to the use of a screen reader, one might
ask how a blind user can start the screen reader? Again, use of a pointing device is implied. Suppose
that the screen reader is easily accessible, will it be able to make sense of the user interface mark-up
(HTML) in the sense and sequence that the developers intended? Maybe so. Therefore, because of
all these circumstances, the traditional email software and platforms fail to cater for the visually
impaired community.
28
3.3.1 Shortfalls of the Existing System
Now let us consider the two systems mentioned in the literature review. The first one created by
Pranjal Ingle et al, had some functionality that is not found in the traditional email platforms. One
example is the ability to read out new mail using TTS and using STT to compose text mail. The
major weakness of this system is that the user has to invoke this functionality by using the mouse.
Only after a mouse click can the text be read out or an audio be recorded.
Email system for the visually impaired by Kumari et al is much like the system by Pranjal Ingle et
al. It primarily relies on mouse events to properly function. Again, this is the major weakness of
their system. Both systems have a common weakness from a performance standpoint. They both do
the TTS and STT conversions on the user device. Battery life of the user device is heavily affected
and also this results in a significant delay due to the heavy processing.
The proposed system will address all the aforementioned weaknesses present in the current systems
by removing the dependency on click events. All program flow will be ushered by voice suggestions
and interactive voice responses thereby making the system/platform more accessible.
29
3.4 Flow Diagram of the Proposed System
The diagram below is an abstraction of the new system showing the participants and services
involved in the system. A detailed overview of the system architecture and all the components
involved are included in the next chapter when the analysis will be dealt with in depth.
CLOUD AI
RECEIVER
USER
MAIL SERVER
The proposed system has three major modifications to the systems that already exist. Firstly, it
eliminates the use of any pointing device or keyboard. This will be done by using interactive voice
responses to control the flow of the software. Secondly, text-to-speech conversions and vice versa
will be handled by a cloud service. That is, the two will no longer be done on the user device but
rather on a dedicated server that is designed specifically for such conversions. Thirdly, this system
will use voice recognition to identify and authenticate a user. Again, this will be supported by cloud
processing. These three modifications are not exhaustive but a highlight of the major changes that
30
Benefits of the new system
1. The new system will be faster compared to the email system for the blind (mentioned
2. User authentication using voice/facial recognition is secure and a viable option for the
visually impaired. Gmail and other e-mail clients alike authenticate a user using a written
password.
3. The proposed system is incredibly cheap and will be free to the end users.
4. The proposed system is depended on voice input alone. It won’t use any pointing device or
the keyboard.
5. The proposed system is platform independent. It will be supported on both desktop and
mobile platforms.
31
REFERENCES
Abner, GH & Lahm, EA. (2012). Implementation of assistive technology with students who are
visually impaired: teachers' readiness. Journal of Visual Impairment and Blindness 96, 97-
112.
Arter, C. (2007). Listening skills, in Mason, H & McCall, S. 1997. Visual impairment: access to
education for children and young people. London: David Fulton.
Bandura Albert,(1977). Social learning theory. General Learning Press. New York City.
Chong, C. (2013). Laptop computers and electronic notetakers for the blind: a comparison. The
Braille Monitor 46, 58-66.
Dobree, JH & Boulter, E. (2002). Blindness and visual handicap: the facts. New York: Oxford
University Press.
Fitts, P. M., & Posner, M. I. (1967). Learning and skilled performance in human performance.
Belmont, CA: Brooks/ Cole.
French, RS. (2004). From Homer to Helen Keller: a social and educational study of the blind. Ann
Arbor, Mich: University Microfilms International.
Garbner, Howard L. (1988): Milwaukee Project: Preventing Mental Retardation in Children at Risk
Hall-Ellis Sylvia, D., Grealy Deborah S.(2013). The Dreyfus Model of Skill Acquisition: A Career
Development Framework for Succession Planning and Management in Academic Libraries.
College & Research Libraries.
Harlow, Harry F. (1949).The formation of learning sets. Psychological Review, Vol 56(1), Jan, 51-
65. Retrieved from - http://psycnet.apa.org/journals/rev/56/1/51/
Hilary Silver (2007). The Process of Social Exclusion: The Dynamics of an Evolving Concept.
SSRN.Retrievedfrom:http://ssrn.com/abstract=1087789
http://www.health.vic.gov.au/agedcare/maintaining/countusin/inclusion.htm
Ingle, P., Kanade, H. and Lanke, A. (2016). Voice based e-mail System for Blinds. International
Journal of Research Studies in Computer Science and Engineering, 3(1).
32
Kirtley, DD. (2015). The psychology of blindness. Chicago: Nelson- Hall.
Koestler, FA. (2016). The unseen minority: a social history of blindness in the United States. New
York: David McKay.
Kumari, D., Pai, N., and Nayak, P. (2017). Voice-based E-mail system for blinds. N.M. A.M.
INSTITUTE OF TE C HNOLOGY
Lowenfeld, B. (1975). The changing status of the blind: from separation to integration. Springfield,
Ill.: Thomas.
Mead George H. (1967).Mind, Self, and Society: From the Standpoint of a Social
Behaviorist .Works of George Herbert Mead, Vol. 1
Mezirow J. and Associates (1990). Fostering Critical Reflection in Adulthood. Jossey Bass, pp. 1-
20.
Perez-Pereira, M. & Conti -Ramsden, G. (1999). Language Development and Social Interaction in
Blind Children. Hove, UK: Psychology Press.
Roberts, FK. (2016). Education for the visually handicapped: a social and educational history, in
Scholl, GT. 1986. Foundations of education for blind and visually handicapped children and
youth: theory and practice. New York: American Foundation for the Blind.
Russell, S. and Norvig, P. (2010). Artificial intelligence. Upper Saddle River, N.J.: Prentice Hall.
Shafer Stacy, (1995). An Introduction to Dr. Lilli Nielsen's Active Learning. TSBVI Visually
Impaired Outreach .VISIONS newsletter, Volume 3, No.
Torreno Stephani (2012), Socialization of blind and visually impaired. Retrieved from
http://www.brighthubeducation.com/special-ed-visual-impairments
Tuttle, DW. (2004). Self-esteem and adjusting with blindness: the process of responding to life's
demands. Springfield, Ill.: Thomas.
Vygotsky, L.S. (1993). The Collected Works of L. S. Vygotsky. Volume 2: The Fundamentals of
Defectology (Abnormal Psychology and Learning Disabilities). Editors of the English
translation: R. W. Rieber and A.S. Carton. New York: Plenum Press.
World Health Organisation (2019) Vision impairment and blindness, [Online]. Available at:
https://www.who.int/news-room/fact-sheets/detail/blindness-and-visualimpairment.
[Accessed: 7 Feb. 2019].
33