0% found this document useful (0 votes)
46 views6 pages

Design and Implementation of Iot-Based Smart

The document discusses the design and implementation of an IoT-based smart home system using voice commands to help disabled people control devices. It allows control of devices like TVs, lights, and fans using voice commands to the Google Assistant without needing to physically operate the devices. The system recognizes voice commands to turn electrical devices on and off. It aims to make interacting with the home environment easier for disabled people using IoT technology.

Uploaded by

Divyanshu Garg
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
46 views6 pages

Design and Implementation of Iot-Based Smart

The document discusses the design and implementation of an IoT-based smart home system using voice commands to help disabled people control devices. It allows control of devices like TVs, lights, and fans using voice commands to the Google Assistant without needing to physically operate the devices. The system recognizes voice commands to turn electrical devices on and off. It aims to make interacting with the home environment easier for disabled people using IoT technology.

Uploaded by

Divyanshu Garg
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 6

2020 International Conference on Smart Technology and Applications (ICoSTA)

Design and Implementation of IoT-Based Smart


Home Voice Commands for disabled people using
Google Assistant
2020 International Conference on Smart Technology and Applications (ICoSTA) 978-1-7281-3083-5/20/$31.00 ©2020 IEEE 10.1109/ICoSTA48221.2020.1570613925

1st Haris Isyanto 2nd Ajib Setyo Arifin 3rd Muhammad Suryanegara
Department of Electrical Engineering Department of Electrical Engineering Department of Electrical Engineering
Universitas Indonesia Universitas Indonesia Universitas Indonesia
Depok, Indonesia Depok, Indonesia Depok, Indonesia
[email protected] [email protected] [email protected]

Abstract— The development of the Internet of Things (IoT) 6] that are familiar with people's lives are 'spun' because
technology has a positive impact on human life. A smart home today's technology mostly uses the all-chip form. The issue
is one of the IoT technology applications that facilitate human of Smart Home, the Internet of Things will come in the form
activities. The problem of physical abnormalities is a matter of of items that we often encounter in the homes of most
limited activities for disabled people. This paper proposes a
people.
design of IoT-based smart home application with a remote
control device that developed using voice commands for Internet of Things (IoT) is the latest technologies in the
disabled people. Smart home control systems help disabled world of the Internet, where this technology will become a
people to control their home electrical devices such as technological trend in the future. Currently, IoT has been
television (TV), lights, and fans using only voice commands expanded. IoT is the leading platform for communication
without moving to turn on or turn off electrical equipment. devices. It is estimated that the numbers of IoT users will
The voice recognition on electrical equipment is using the improve massively where the economy grows significantly.
Google Assistant's application on smartphones. The Google It was estimated in the biomedical or health sector. Besides,
Assistant application will accept voice commands when the IoT is experiencing rapid growth not only in the health or
pronunciation is correct. Voice commands on IoT-based Smart
biomedical sector but in relevant application services as well
Home are more simple to apply, without typing text messages.
Users get convenience compared to using text. The signal [7-9].
strength of an Internet connection will create a useful Based on the Report of The Institute of Electrical and
performance device at the Response Time of Google Assistant, Electronics Engineers (IEEE) 2012 that IoT has been
Response Time of System Processing, activating and defined into three parts: sensor, network, and internet
deactivating Electrical Equipment. We expect that this device connection [10]. The International Telecommunication
could be more useful to help disabled people interact with their Union (ITU) as a source of reference and information in the
environment by utilizing IoT technology facilities. field of telecommunications standards has defined IoT as a
public infrastructure used for the information society, which
Keywords—the internet of things, smart home, voice
commands, disabled people, google assistants
provides interconnection services both physical and virtual.
It is based on operations and developments in the field of
I. INTRODUCTION information and communication technology.
Today's human activities are inseparable from the use of In short, the IoT is composed of three parts: network,
computers and smartphones. It is because of the sensor, and application usage. Several communication
development of internet technology as a general technologies can be used to support the connection of
communication for human needs in communicating through devices to the IoT [11].
the internet. The need for using an internet connection is After we were introduced to IoT Technology, smart
increasing, where the internet can be connected home research and development became popular in the last
continuously. few days. IoT-based Smart Home is an application that
A smart home is a new concept of household. A smart could facilitate human activities to control many devices,
home provides comfort, safety, energy-saving potential for such as electrical equipment, via the internet connection.
the house at any time [1-3], which gives a better quality of Besides, various wireless technologies could help connect
life for the people [4]. The smart home is here to facilitate from remote areas to develop the intelligence of the home
the occupants of the house in managing all matters relating environment. Sophisticated IoT networks are being formed
to the comfort of themselves as residents of the house, to meet human needs in terms of connections with other
ranging from safety issues to the matter of accessing devices things. IoT technology is utilized to generate innovative
that are made more interactive and can be 'controlled' ideas and significant growth for smart homes to improve
through just one device, the application on a smartphone or living standards [12].
other device. Smart Home is a part of the innovation of the In social life, the existence of people with disabilities is
Internet of Things, where all everyday objects or devices [5, part of our lives. They also need attention, because no one
wants it like that. Therefore we must respect them. The

978-1-7281-3083-5/20/$31.00 ©2020 IEEE

Authorized licensed use limited to: University of Wollongong. Downloaded on May 31,2020 at 21:59:50 UTC from IEEE Xplore. Restrictions apply.
2020 International Conference on Smart Technology and Applications (ICoSTA)

problem of physical disorders is a problem of disabled systems by market share copyright © 2015 The Nielsen
people, where physical limitations make it difficult for them Company [13], as shown in Table I.
to move more freely.
TABLE I. TOP U.S. SMARTPHONE OPERATING SYSTEMS BY MARKET
We propose a design of the IoT-based Smart Home SHARE COPYRIGHT © 2015 THE NIELSEN COMPANY
device. This research aims to help people with physical
disabilities so they can continue their activities around their No Smartphone Operating Systems User Percentage
home environment. Therefore, this research designed an IoT 1 Android OS 52.6 %
Smart Home device that can help disabled people to control 2 Apple iOS 42.7 %
electronic equipment or electrical equipment, such as 3 Microsoft 2.8 %
television (TV), lights, and fans [10] with voice commands
4 Blackberry 0.7 %
to Android smartphones using Google Assistant. This
device can be controlled and accessed remotely. It makes it 5 Other 1.2 %
easier for disabled people to utilize it without touching them
physically. Disabled people do not need to move anymore to
turn on and turn off electrical equipment at home. The use
of this device is not only used for disabled people but can
also be used for paralytic, elderly people and anyone who It turns out that this Android smartphone becomes the
needs it. most popular smartphone operating system not only in
Indonesia and America but also in the world. Unlike iOS,
II. RELATED WORK which is only made by Apple smartphones, but Android
A. Voice Commands Technology smartphones can be used by companies such as Samsung,
The voice recognition on electrical equipment is using LG, Motorola, Huawei, and many more.
voice commands application on the smartphone. Digital The percentage from the International Data Corporation
sound processing is controlled by an application to (IDC) shows that Android smartphones have 82.8 % market
recognize the detected voice commands, which are often share worldwide, while Apple iOS smartphones only gain
called Voice Recognition. This technology works by 13.9 %. This difference is apparent that Android
capturing the human voice that is converted into a digital smartphones are more desirable compared to other
format so that it can be translated into a system. Then the smartphones.
system will compare the input information that has been in B. Technology for Disabled People
the form of a digital format with a voice database that has The way to increase the involvement of people with
been set. disabilities is through the use of appropriate assistive
The design used in this research uses a wireless sound technology. Technology for disable people provides
system, which controls electrical appliances such as TV, information knowledge that refers to the field of device
lights, and fans. The function of this voice control is as a technology and assistive technology services. It relates to
controller to activate and deactivate electrical equipment by the lives of users with disabled people. This paper was
replacing the button function with voice commands through written to provide a broad understanding of Technology for
wireless modem and internet. The development of voice Persons with disable people that cover the field of research
control using the Google Assistant Application could and development of community service activities, especially
become a future home reference. Where we do not need to for disabled people. Disability is a temporary or permanent
move only with voice commands can activate and deactivate functional limitation experienced by people of various ages
home electrical equipment even though it is somewhere and under any circumstances. This paper is related to
different in the house. disability technology which is a means of supporting or
Google Assistant is a virtual assistant application providing assistance and compensation to people with
supported by artificial intelligence technology, which was disabilities in their daily functioning.
developed by Google, mainly available on mobile devices The North American Assistance Engineering and
and smart home devices. Technology Rehabilitation Society states that aid technology
Almost all Android smartphones have a feature Google has been proven to help people with disabilities improve
Assistant Application. If not, we could get it on the Google their quality of life. With technological devices specifically
Play Store to install the application. Google Play Store is a designed to meet individual needs, people with disabilities
free application and open source to install anythings of can improve and optimize their daily functions, enabling
application for Android smartphone. them to be independent, independent and confident. For
In Indonesian, Android smartphone users do dominate example, individuals with mobility impairments can benefit
the mobile market. We can see Android smartphones from a wheelchair system and artificial limbs that increase
everywhere, but not so with Apple smartphones. The independence.
existence of Apple smartphones in Indonesian is only a few Following the guidelines of the World Health
percent of Android. Organization (WHO), many public and private hospitals
It also happens in other countries. New research released by type A or B with rehabilitation centers, private companies
Nielsen in the third quarter of 2015 said that 52.6 % of and non-governmental organizations provide technology to
smartphone owners in America use the Android operating individuals with disabilities. Providers of assistive
system. While Apple iOS users are only 42.7 %, this is quite technology devices promote modalities which include
surprising considering that America is the home country of mobility aids, wheelchairs and seating systems.
Apple iOS. Some, as a result, top U.S smart operating

Authorized licensed use limited to: University of Wollongong. Downloaded on May 31,2020 at 21:59:50 UTC from IEEE Xplore. Restrictions apply.
2020 International Conference on Smart Technology and Applications (ICoSTA)

These assistive technology tools can help fulfill the life application is more simple. Because with voice commands,
goals of people with disabilities, especially by enabling the users get more convenience compared to using text.
active participation and interaction in education and work. Users only send voice commands to the Google Assistant
Going forward, the government and citizens of Indonesia Application and the system will automatically display the
must become advocates for people with disabilities by text messages that we said before. It means that users do not
promoting inclusion and equality in aspects of life every need to type text messages again. Some, as a result, are
day. In addition to ending the stigma and discrimination types of the application for IoT smart home control system,
against them, aid technology can be one of the catalysts to as shown in Table II.
help our country be truly inclusive for all.
This paper proposes a design of IoT-based smart home TABLE II. Type of Applications For IoT Smart Home Control System
application with a remote control device that developed Control Type of Send Commands Ref
using voice commands for disabled people. This device System Applications
helps disabled people to control their home electrical IoT-based 1. SMS Typing text [15]
Smart Home message
devices using voice commands without moving to turn on or 2. Telegram Typing text [16]
turn off electrical equipment. The voice recognition on message
electrical equipment is using the Google Assistant's 3. Blynk Apps Typing text [17]
application on smartphones. message
4. Web Typing text Web [18]
III. SYSTEM MODEL & Typing text
message
Smart home control systems allow humans to control 5. Google Voice Command This
their home electrical devices such as TV, lights, and fans Assistant & Without Typing Paper
through wireless modem and internet using only voice text message
commands. This smart home control works when it says OK
GOOGLE, which then continues the command that has been
set through the program. This system will help disabled
people to control electrical equipment without moving
around to turn on or turn off. Digital sound processing is
controlled with an application to recognize the detected
voice commands. Therefore, the method to be designed is a
voice recognition application as controller of
microcontroller-based electrical equipment through wireless
modem and internet [14]. The application of voice
recognition applications on electrical equipment uses a relay
that functions as a switch using the Google Assistants
application on the smartphone so that pronunciation can be
conducted remotely. Fig. 1 depicts the system model of the
proposed implementation of IoT-based smart home voice
commands using Google Assistants.

Fig. 1. The system model of the proposed design for IoT-based smart home
Fig. 2. Flowchart of Activating and Deactivating the Electrical Equipment
voice commands using google assistant
Control System Using Google Assistants
From previous researches on the IoT Smart Home The following flowchart explains the steps of the overall
control system, there are 4 (four) types of the application program flow in Activating and Deactivating the Electrical
used such as Short Message Service (SMS) [15], Telegram Equipment Control System Using Google Assistant, as
[16], Blynk Apps [17], and Web [18]. When the user uses shown in Fig. 2:
the application to control electrical equipment in the smart • When starting, execute the program process
home, then the user needs to type the text message in initiation.
advance to send the command while the Google Assistant

Authorized licensed use limited to: University of Wollongong. Downloaded on May 31,2020 at 21:59:50 UTC from IEEE Xplore. Restrictions apply.
2020 International Conference on Smart Technology and Applications (ICoSTA)

• The program runs with the Microcontroller of


NodeMCU ESP8266 in the standby mode position
waiting for messages from the user.
• If the Microcontroller of NodeMCU ESP8266 is not
connected to the internet, it will return to the standby
mode position. Check Internet Connection
• If the Microcontroller of NodeMCU ESP8266 is
connected to the internet, it is ready to receive the
next command message.
• Next, open and run the Google Assistant application.
• If the voice command message from the user's voice
pronunciation is correct, saying OK GOOGLE
TURN ON ”ELECTRICAL EQUIPMENT” on the
Google Assistant application, then the message
becomes the keyword to TURN ON the
Fig. 3. The circuit implementation of the electrical equipment control
ELECTRICAL EQUIPMENT, such as TV, Front system
Light, Fans. Then ACTIVATE ”ELECTRICAL
EQUIPMENT”
• Next, if the voice command message from the user's
voice pronunciation is correct, saying OK GOOGLE
TURN OFF ”ELECTRICAL EQUIPMENT” on the
Google Assistant application, then the message
becomes the keyword to TURN OFF the
ELECTRICAL EQUIPMENT. Then DEACTIVATE
”ELECTRICAL EQUIPMENT.”
• If the voice command message from the user's voice
pronunciation is not correct on the Google Assistant
application, then the message will be rejected. (It
could not activate it). Check Pronunciation. Fig. 4. The prototype of the electrical equipment control system
• The end, it is finished
IV. TESTING AND RESULT
The following Pseudocode of Activating and
Deactivating the Electrical Equipment Control System After the design of the device is complete, the next step
Using Google Assistant, as described in Algorithm. 1: is to check, test and measure the device. This stage aims to
check the overall function and performance of the device.
Algorithm 1: Activating and Deactivating the Electrical
Equipment A. Checking Voice Pronunciation to Google Assistant
Application
1 Initialization: execute the program process This Checking aims to check the pronunciation of
2 Run NodeMCU voices. Voice Pronunciation must be correct and precise
3 if NodeMCU Connect to the Internet? then when communicating with an Android smartphone through
4 Open Google Assistant and System Running the Google Assistant Application. If the voice pronunciation
5 else if Check Internet Connection is correct and precise, then the Google Assistant Application
6 if say OK GOOGLE TURN ON ”ELECTRICAL will accept it. Furthermore, if the pronunciation of the voice
EQUIPMENT”? then is incorrect and unclear, the Google Assistant Application
7 Activate ”ELECTRICAL EQUIPMENT” will reject it. For Checking Voice Pronunciation to Google
8 else if say OK GOOGLE TURN OFF ”ELECTRICAL Assistant Application, as shown in Table III.
EQUIPMENT”? then
9 Deactivate ”ELECTRICAL EQUIPMENT”
10 else Check Voice Pronunciation
11 end

The circuit implementation of the control system


consists of the microcontroller of NodeMCU ESP8266,
Modem Wireless, relay, Power Supply Unit (PSU) and
output socket to control electrical equipment, as shown in
Fig. 3. Then the Prototype of the control system, as shown
in Fig. 4.

Authorized licensed use limited to: University of Wollongong. Downloaded on May 31,2020 at 21:59:50 UTC from IEEE Xplore. Restrictions apply.
2020 International Conference on Smart Technology and Applications (ICoSTA)

TABLE III. Checking voice pronunciation to Google assistant C. Testing Deactivates All Control System Electric
Application
Equipment
This system test aims to test the performance of the
Correct Voice Google Assistant
Pronunciation Response
device and the relationship between hardware and software
Number of
Experiments Yes No Accepted Rejected for the Google Assistant Application program. With this
(Y) (N) (A) (R) testing, we can find out whether the performance of the
1 Y A device is working by the expected design. We are testing the
2 Y A performance of the device when deactivating the control
3 Y A
4 Y A
system of electrical equipment, as shown in Fig. 6. So we
5 Y A measure the Device Response Time using a stopwatch.
6 Y A The parameters measured are as follows:
7 Y A • Measuring Response Time for Google Assistant
8 Y A Applications:
9 Y A
10 Y A
Measurements are starting from the time of
11 Y A pronunciation of the words conveyed to obtain
12 Y A answers back from Google Assistant
13 Y A • Measuring the Response Time from switch Off of
14 Y A Electrical Equipment:
15 Y A
16 Y A
Measurements are starting from the time of the
17 Y A response back from Google Assistant submitted to
18 N R switch Off of Electrical Equipment.
19 Y A
20 Y A

B. Testing Activates All Control System Electric Equipment


This test aims to test the performance of the device and
the relationship between hardware and software for the
Google Assistant Application program. With this testing,
we can find out whether the performance of the device is
working by the expected design. We are testing the
performance of the device when activating the control
system of electrical equipment, as shown in Fig. 5. So we
measure the Device Response Time using a stopwatch.
The parameters measured are as follows:
• Measuring Response Time for Google Assistant Fig. 6. Testing Deactivate All Control System Electric Equipment
Applications:
Measurements are starting from the time of The android smartphones for voice commands using the
pronunciation of the words conveyed to obtain Google Assistant Application are illustrated in Fig. 7.
answers back from Google Assistant
• Measuring the Response Time from switch ON of
Electrical Equipment:
Measurements are starting from the time of the
response back from Google Assistant submitted to
switch ON of Electrical Equipment

Fig. 7. Illustration of the android smartphones for voice commands using


Google Assistant Application
Fig. 5. Testing Activate All Control System Electric Equipment

Authorized licensed use limited to: University of Wollongong. Downloaded on May 31,2020 at 21:59:50 UTC from IEEE Xplore. Restrictions apply.
2020 International Conference on Smart Technology and Applications (ICoSTA)

V. CONCLUSIONS AND FUTURE WORK [14] N. Hayati and M. Suryanegara, "The IoT LoRa system design for
tracking and monitoring patient with a mental disorder," in 2017
In this paper, we design and implement IoT-based smart IEEE International Conference on Communication, Networks, and
home voice commands for disabled people using Google Satellite (Comnetsat), 2017, pp. 135-139.
Assistant. This system would help disabled people to control [15] P. Bhatt and B. Thakker, Secure IoT-GSM based Smart Home
System with Confidentiality and Integrity. 2017.
electrical equipment such as TV, lights, and fans using voice [16] M. Muslih et al., "Developing Smart Workspace Based IoT with
commands of Google Assistant on smartphones. Users do Artificial Intelligence Using Telegram Chatbot," in 2018
not need to move to turn on or turn off electrical equipment. International Conference on Computing, Engineering, and Design
The Google Assistant application will accept voice (ICCED), 2018, pp. 230-234.
[17] H. Durani, M. Sheth, M. Vaghasia, and S. Kotech, "Smart
commands when the pronunciation is correct. Voice Automated Home Application using IoT with Blynk App," in 2018
commands are more simple to apply, without typing text Second International Conference on Inventive Communication and
messages. Users get convenience compared to using text. Computational Technologies (ICICCT), 2018, pp. 393-397.
Users only send voice commands to the Google Assistant [18] N. Lee, H. Lee, H. Lee, and W. Ryu, "Implementation of smart home
service over the web of object architecture," in 2015 International
Application, and the system will automatically display the Conference on Information and Communication Technology
text messages that we said before, without typing text Convergence (ICTC), 2015, pp. 1215-1219.
messages. The signal strength of an Internet connection will
create a useful performance device at the Response Time of
Google Assistant, Response Time of System Processing,
activating and deactivating Electrical Equipment. Future
work is to make and test the system in a real scenario.
Further research, there are several challenges to developing
devices using Wireless Sensor Network, NB-IoT and 5G
networks to get low latency and the best signal strength.
Then this will build a better device testing performance.
REFERENCES
[1] S. A. Celtek, M. Durgun, and H. Soy, "Internet of Things based
smart home system design through wireless sensor/actuator
networks," in 2017 2nd International Conference on Advanced
Information and Communication Technologies (AICT), 2017, pp. 15-
18.
[2] K. Guravaiah and R. L. Velusamy, "Prototype of Home Monitoring
Device Using Internet of Things and River Formation Dynamics-
Based Multi-Hop Routing Protocol (RFDHM)," IEEE Transactions
on Consumer Electronics, vol. 65, no. 3, pp. 329-338, 2019.
[3] X. Li, R. Lu, X. Liang, X. Shen, J. Chen, and X. Lin, "Smart
community: an internet of things application," IEEE
Communications Magazine, vol. 49, no. 11, pp. 68-75, 2011.
[4] D. Wang, "The Internet of Things the Design and Implementation of
Smart Home Control System," in 2016 International Conference on
Robots & Intelligent System (ICRIS), 2016, pp. 449-452.
[5] S. Tang, V. Kalavally, K. Y. Ng, and J. Parkkinen, "Development of
a prototype smart home intelligent lighting control architecture using
sensors onboard a mobile computing system," Energy and Buildings,
vol. 138, pp. 368-376, 2017/03/01/ 2017.
[6] S. D. T. Kelly, N. K. Suryadevara, and S. C. Mukhopadhyay,
"Towards the Implementation of IoT for Environmental Condition
Monitoring in Homes," IEEE Sensors Journal, vol. 13, no. 10, pp.
3846-3853, 2013.
[7] M. Suryanegara, A. S. Arifin, M. Asvial, and G. Wibisono, "A
system engineering approach to the implementation of the Internet of
Things (IoT) in a country," in 2017 4th International Conference on
Information Technology, Computer, and Electrical Engineering
(ICITACEE), 2017, pp. 20-23.
[8] A. S. Arifin, M. Suryanegara, T. S. Firdaus, and M. Asvial, "IoT-
Based Maritime Application: An Experiment of Ship Radius
Detection," presented at the Proceedings of the International
Conference on Big Data and Internet of Thing, London, United
Kingdom, 2017.
[9] L. Atzori, A. Iera, and G. Morabito, "The Internet of Things: A
Survey," Computer Networks, pp. 2787-2805, 10/01 2010.
[10] A. B. Chebudie, R. Minerva, and D. Rotondi, "Towards a definition
of the Internet of Things (IoT)," 2014.
[11] A. Al-Fuqaha, M. Guizani, M. Mohammadi, M. Aledhari, and M.
Ayyash, "Internet of Things: A Survey on Enabling Technologies,
Protocols, and Applications," IEEE Communications Surveys &
Tutorials, vol. 17, no. 4, pp. 2347-2376, 2015.
[12] D. Pavithra and R. Balakrishnan, "IoT based monitoring and control
system for home automation," in 2015 Global Conference on
Communication Technologies (GCCT), 2015, pp. 169-173.
[13] G. P. Schneider, Electronic commerce. Stamford, CT: Cengage
Learning, 2015.

Authorized licensed use limited to: University of Wollongong. Downloaded on May 31,2020 at 21:59:50 UTC from IEEE Xplore. Restrictions apply.

You might also like