Novel Navigator for Visually Impaired

Project report submitted in partial fulfillment of the requirements for the award of degree of Master of
Science in Information Technology

Master of Science in Information Technology

by
PINKI MALAKAR
019151 of 2019-2020

Under the Supervision and Guidance of

Mr. Binoy Das

Senior Technical Officer, HOD

Department of Computer Science and Engineering

Department of Information Technology

National Institute of Electronics & Information Technology
(NIELIT), Agartala Centre

Affiliated to Tripura University

.
May, 2024
 UNDERTAKING

I declare that the work which is being presented in this project report entitled “Novel
Navigator for Visually Impaired”, submitted to the Information Technology Department,
National Institute of Electronics and Information Technology (NIELIT), Agartala
Centre, for the award of the degree of Master of Science in Information
Technology, is an authentic record of my own work carried out under the supervision
and guidance of Mr. Binoy Das and co-supervision of Mr. Subhrajit Roy. I have not
plagiarized or submitted the same work for the award of any other degree. In case this
undertaking is found incorrect, I accept that my degree may be unconditionally
withdrawn.

May, 2024
Agartala
Pinki Malakar

ii
 CERTIFICATE OF APPROVAL

Certified that the work contained in the project report entitled “Novel Navigator for
Visually Impaired”, by Pinki Malakar, Registration Number 019151 of 2019-2020 to
National Institute of Electronics and Information Technology (NIELIT), Agartala
Centre, Tripura, India, is a record of bonafide project work carried out under my
supervision and guidance and is worthy of consideration for the award of the degree
of Master of Science in Information Technology of the NIELIT Agartala.

Mr. Binoy Das Mr. Subhrajit Roy

Senior Technical Officer, HOD Faculty
Department of Computer Science and Department of Computer Science and Engineering
Engineering NIELIT, Agartala
NIELIT, Agartala
Tripura
Tripura

Mrs. Ambalika Dey

Senior Technical Officer, HOD of
BCA and M.Sc. (IT)
NIELIT, Agartala
Tripura

iii
 CERTIFICATE

This is to certify that the project entitled Novel Navigator for Visually Impaired
submitted by Pinki Malakar, Registration No 019151 of 2019-2020 is approved for
the award of Degree of Master of Science in Information Technology and the project
evaluation and viva-voce examination has been held on date.

INTERNAL EXAMINER EXTERNAL

EXAMINER

iv
Acknowledgement

I would like to take this opportunity to express my deep sense of gratitude to all who
helped me directly or indirectly during this project work.

Firstly, I would like to thank my supervisor, Mr. Binoy Das and co-supervision of
Mr. Subhrajit Roy, for being a great mentor and the best adviser I could ever have.
His advise, encouragement and critics are source of innovative ideas, inspiration and
causes behind the successful completion of this dissertation. The confidence shown
on me by him was the biggest source of inspiration for me. It has been a privilege
working with him from last six month.

I am highly obliged to all the faculty members of Information Technology

Department for their support and encouragement. I also thank our HoD, Mrs.
Ambalika Dey, for providing excellent computing and other facilities without which
this work could not achieve its quality goal.

Finally, I am grateful to my parents for their support. It was impossible for me to

complete this project work without their love, blessing and encouragement.

- Pinki Malakar

v
 Dedicated to

To My Loving Family for their kind love & support.

To my project supervisor Prof. Supervisor Name for sharing his valuable
knowledge, encouragement & showing confidence on me all the time.

vi
 You can’t teach people everything they need to know. The best you
can do is position them where they can find what they need to know
when they need to know it.
-Seymour Papert (MIT Mathematician)

vii
 Abstract

The mobility and quality of life of the visually impaired people are greatly impacted
by the various obstacles they experience while attempting to navigate unfamiliar
areas on their own. In this project, a novel navigator that offers context-aware, real-
time advice and help in real-time to people with visual impairments are introduced.
The Novel Navigator creates an easy-to-use and efficient navigation system by
combining cutting-edge technology like computer vision and machine learning.
Through the use of a portable camera device, the system records the user's
environment and analyses it to detect barriers, landmarks, and other pertinent aspects.
Personalized navigation directions that are based on the user's preferences and
particular environmental conditions are produced by sophisticated algorithms that
evaluate this data. An innovative approach to improving mobility and autonomy in
world navigation, the Novel Navigator is a potential development in assistive
technology for the blind. Millions of people with visual impairments might benefit
from the Navigator's ability to improve their quality of life by utilizing state-of-the-art
technology and user-centerer design approaches.

viii
 Contents

Acknowledgement Dedicated to Abstract v

1 Introduction vi

viii

1
1.1 Project Profile . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.2 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
1.3 Motivation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
1.4 Goal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

2 Initial System Study 3

2.1 Chapter Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
2.2 About Organization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
2.3 Drawbacks of the existing system . . . . . . . . . . . . . . . . . . . . . . . . 4
2.4 Problem definition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
2.5 The proposed system . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
2.6 Scope of the system . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
2.7 Scope of this project . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
2.8 System development approach . . . . . . . . . . . . . . . . . . . . . . . . . . 6

ix
 2.8.1 Subsection here . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

3 Feasibility Analysis 7
3.1 Section Name . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

4 System Analysis 9
4.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
4.2 Data flow diagram of the land acquisition process......................................................................11
4.3 Physical and behavioural aspects of the system..........................................................................12
4.3.1 Sub section here 12

5 Software Requirements Specifications 15

5.1 General Description.....................................................................................................................15
5.1.1 Product Perspective.....................................................................................................................15
5.1.2 Product Functions 16
5.1.3 User Characteristics.....................................................................................................................16
5.1.4 General Constraints.....................................................................................................................16
5.1.5 Assumptions and Dependencies..................................................................................................16
5.1.6 Functional Requirements.............................................................................................................17
5.1.7 Functional Requirement 1............................................................................................................17
5.2 External Interface Requirements.................................................................................................17
5.2.1 User Interfaces 17
5.2.2 Hardware Interfaces.....................................................................................................................17
5.2.3 Software Interfaces......................................................................................................................17
5.3 Performance Requirements..........................................................................................................18
5.4 Design Constraints.......................................................................................................................18
5.4.1 Standard Compliance...................................................................................................................18
5.4.2 Hardware Constraints..................................................................................................................18
5.4.3 Other Requirements.....................................................................................................................18
5.4.4 Scope of this project....................................................................................................................18

6 System design 19
6.1 Introduction..................................................................................................................................19
6.2 System Architecture.....................................................................................................................19

6.3 Module Design.............................................................................................................................20

x
6.4 Database Design..........................................................................................................................20
6.5 Input Output Design....................................................................................................................20
6.6 Algorithm design.........................................................................................................................21
6.7 Electronic Data Communication Design.....................................................................................21
6.8 System Maintenance....................................................................................................................21
6.9 Other Alternatives Considered....................................................................................................22

7 System Implementation 23
7.1 Hardware Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
7.2 Software Environment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
7.3 System Development Platform....................................................................................................24
7.4 Project Accomplishment Status...................................................................................................24
7.5 Guidelines for Continuation........................................................................................................24
7.6 Hardware Components................................................................................................................24
7.7 Software Environment.................................................................................................................24

8 System Testing 25
8.1 Test Plan . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
8.2 Test Cases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25

9 Conclusion & Future Direction of Work 26

9.1 Conclusion...................................................................................................................................26
9.2 Future Direction of work.............................................................................................................26

References 27

A User Manual 29
A.1 Installation Manual......................................................................................................................29
A.2 Reference Manual........................................................................................................................29
A.3 Maintenance Manual...................................................................................................................29

B Test Report 30

C Input Output Formats 31

C.1 Paper Forms used in the Organisation.........................................................................................31

xi
C.2 Input Forms in the New System..................................................................................................31
C.3 Output Formats in the New System.............................................................................................31

D Source Code 32

xii
 List of Figures

1 IEEE LTSA Client Server Architecture[6] . . . . . . . . . . . . . . . . . . . . 5

2 IEEE LTSA in SOA environment . . . . . . . . . . . . . . . . . . . . . . . . . 8

3 Give a caption to your image here...............................................................................................13

4 caption of image here...................................................................................................................16

xv
List of Tables

xvi
 z

Chapter 1
Introduction

Technology has made it possible for ground-breaking inventions that change people's
lives, especially for those who are disabled. Such developments are demonstrated by
the "Novel Navigator" project, which seeks to provide visually impaired people with
previously unheard-of levels of mobility and autonomy. In order to help visually
impaired people navigate diverse situations securely and autonomously, this project
presents a complex navigation system that incorporates state-of-the-art technology.
Detecting impediments, interpreting the environment, and providing real-time audio
direction are all made possible by a collection of sophisticated algorithms and sensory
devices at the core of the Novel Navigator. The system provides a seamless
experience that goes beyond conventional navigational aids by utilizing the strengths
of machine learning, computer vision, and augmented reality. In addition to being a
technological wonder, the Novel Navigator is a symbol of inclusion that gives
visually impaired people the confidence and comfort to explore the world. The
detailed design, development, and implementation of the Novel Navigator are
explored in this project, which also emphasizes the tool's potential to transform
accessibility and promote inclusivity.

1.1 Project Profile

Project title is “Novel Navigator for Visually Impaired”, by Pinki Malakar,

Registration Number 019151 of 2019-2020 to National Institute of Electronics and
Information Technology (NIELIT), Agartala Centre, Tripura, India, project work
carried out under the supervision and guidance of Mr. Binoy Das and co-supervision
of Mr. Subhrajit Roy, and project duration is three months.

1
7
 z

Computing Environments:
Development Environment: PyCharm IDE
Operating System: Windows 11
Technologies:

Machine Learning, Python, Keras, TensorFlow, pyttsx3.

1.2 Overview

Navigating the world's many hurdles and challenges can be challenging, particularly
for individuals with vision impairments. The world is a complex and dynamic place.
A considerable gap still exists in the availability of practical, inexpensive, and easy-
to-use navigation solutions for the community of blind people, even with the latest
technological developments. New Navigator for the Visually Impaired project is
presented in this project report. In order to improve the quality of life for visually
impaired people, we want to create a system that will allow them autonomously
navigate their surroundings and improve their comprehension of it. Our innovative
navigation makes use of cutting-edge technologies like computer vision, machine
learning, python, and artificial intelligence (AI) to analyse the actual environment,
identify barriers, and provide customers real-time direction. The system is designed to
be easy to use, straightforward, and flexible enough to work in a variety of contexts,
including businesses and residences as well as parks and city streets.

Fig. 1. Level-0 Data Flow Diagram of a Novel

Navigator for Visually Impaired

1.3
Motivation

Individuals with visual impairments have particular difficulties on a daily basis.

Whether you're navigating busy metropolitan streets, packed public transportation, or
intricate interior spaces, navigating new situations may be intimidating. Developing a
revolutionary navigation system that surpasses current constraints is the goal of the
Novel Navigator project. Our goal is to provide visually impaired people a renewed
1
8
 z

sense of freedom, security, and confidence. In order to enable people to travel the
globe with ease and dignity, we want to close the gap between accessibility and
disability. Not only is The Novel Navigator a project, but it also makes a promise: it
will open doors for those who face life with optimism and tenacity.
Department of Information Technology, NIELIT Agartala

1.4 Goal

We want to enable visually impaired people to safely and freely navigate their
environment, which is why we are working on a project called Novel Navigator for
the Visually Impaired. Our goal is to do this by creating and deploying a cutting-edge
navigation system that is easy to use, instinctive, and efficient.

Fig. Flow Chart of Novel Navigator

1
9
 z

Chapter 2
Initial System Study

2.1 Chapter Introduction

The world is a complicated and multifaceted place, full with difficulties and barriers
that anybody may find challenging to overcome. These difficulties are magnified for
the sight handicapped, making even the most straightforward tasks difficult. It is clear
that a solution is needed to enable people who are blind or visually impaired to safely
and freely traverse their environment. The Novel Navigator is made to enable those
who are visually impaired by giving them the means to confidently and easily explore
their surroundings. Though it will be a difficult road to create a more inclusive
environment for visually impaired people, we believe that the Novel Navigator will
be a major step in the right direction. Our goal is to use technology to change the way
visually impaired people interact with their surroundings and provide them more
freedom and opportunities.

2.2 About Organization

The National Institute of Electronics & Information Technology (NIELIT) Agartala is
a premier institute under the Ministry of Electronics and Information Technology,
Government of India. NIELIT Agartala is dedicated to providing education and
training in electronics and information technology. It plays a vital role in promoting
digital literacy and skill development in the region.

The institute offers various courses and certifications, aiming to enhance the
employability and technical skills of students. NIELIT Agartala is also involved in
2
0
 z

numerous research and development projects, fostering innovation and technological

advancement. The “Novel Navigator for Visually Impaired” project is initiative to
leverage technology for societal benefit.

2.3 Drawbacks of the existing system

When it comes to offering complete navigation aid, the many assistive technologies
accessible to people with visual impairments frequently fall short. A few of the main
issues with the current systems are as follows:

• Restricted Obstacle Detection: While these systems are capable of identifying

physical barriers, they frequently fall short when it comes to identifying more
intricate dangers such as shifting items, low-hanging obstructions, or shifts in the
landscape.

• Absence of Contextual Information: The user's surroundings are not contextually

informed by current systems. For instance, they may notify the user of an impediment
but not specify what it is—for instance, a wall, a stairway, or a driving car.

2.4 Problem definition

This initiative seeks to solve the main issue of the dearth of useful navigational aids
for those with visual impairments. The ability of visually impaired people to
autonomously and securely navigate their surroundings remains severely limited,
even with the advances in technology. Contextual information is lacking in the
current systems, which limits their ability to recognize obstacles.

To address these issues, the Novel Navigator for the Visually Impaired was created.
But creating such a system comes with a number of challenges:

Obstacle Detection: A variety of impediments, including as stationary objects,

moving objects, and changes in the landscape, must be properly detected by the
system.

2
1
 z

Contextual Data: The user's environment must be represented in the system's

contextual data. This entails creating complex data processing algorithms and giving
the user insightful feedback.
Dynamic situations: Accurately measuring distance can be challenging in dynamic
situations since objects are always shifting. For the system to take these changes into
account, distance measurements must be updated in real-time.

2.5 The proposed system

The technology enables the user to recognize every potential barrier in the
surrounding area. The speech-based approach moreover offers every conceivable
summary of impediments. Therefore, a user can know by utilizing this system. From
this vantage point, one may comfortably proceed forward whether or not there are
any barriers.

Fig. Flow chart of proposed system

2
2
 Department of Information Technology, NIELIT Agartala

2.6 Scope of the system

Enhanced Mobility and Independence: It lessens reliance on other people and gives
users the freedom to autonomously explore new places.

Safety and Risk Reduction: The technology helps avert collisions and injuries by
identifying obstructions and sending out notifications. By avoiding collisions with
objects, barriers, or other pedestrians, users can increase their level of safety when
traveling.

Financial Savings: For those who help the blind and visually impaired, lowering the
requirement for human aid in navigating can result in financial savings.

2.7 Scope of this project

This project has been done in the fourth semester of the Master of Science in
Information Technology (MSc.IT.) course of NIELIT Agartala. The period of work is
roughly three months. Within this project we accomplish the following part of the
system proposed above:

1. Real-Time Object Detection: This technology use computer vision techniques to

identify obstacles in the user’s path.

2. Path Prediction: Machine learning algorithms will predict the safest and most
efficient route for the user.

3. Haptic Feedback: The device will communicate with the user through intuitive
vibration patterns.

4. User Interface: A simple and accessible user interface will allow users to interact
with the device effectively.

5. The project assumes that users have a basic understanding of how to operate wearable
technology.

2
3
 Department of Information Technology, NIELIT Agartala

6. It is assumed that the device will be used in a variety of environments, both indoor
and outdoor.

2.8 System development approach

We can guarantee that the Novel Navigator for Visually Impaired is produced in an
organized, effective, and efficient manner by adhering to this methodical
methodology. This will contribute to guaranteeing both the project's success and the
users' happiness.

2.8.1 An analysis of requirements

The initial step is compiling and examining the system requirements. This entails
being aware of the features that users who are visually impaired would like to see in a
navigation, as well as the technological limitations.

2.8.2 Design of Systems

A thorough system design will be produced based on the specifications. Choosing the
right machine learning algorithms and sensor technologies, as well as designing the
user interface, are all part of this.

2.8.3 Incorporation

As per the design parameters, the system will be installed. Included in this are the
creation of the software, the hardware components, and the machine learning model
integration.

2.8.4 Assessment

The system will undergo extensive testing to make sure it satisfies all specifications
and operates as planned. Unit, integration, and user acceptability testing are all
included in this.

2.8.5 Utilization

Upon successful testing and approval, the technology will be made available for use
by those with visual impairments. The creation of wearable technology, its
dissemination, and user education are all included in this.

2.8.6 upkeep

To guarantee that the system keeps working properly after deployment,

2
4
 Department
routine maintenance will be needed. of user
This covers Information
support, Technology, NIELIT Agartala
hardware maintenance,
and software upgrades.

2.8.7 Review

Periodically, the system will be reviewed to determine its efficacy and pinpoint areas
in need of development. Impact analysis, system performance analysis, and user input
are all included in this.

2
5
 Chapter 3
Feasibility Analysis

The feasibility analysis shows that with present technology, it is theoretically possible
to construct a revolutionary navigation system for the visually handicapped. Securing
money and controlling expenses to guarantee affordability are necessary for
economic viability. Planning ahead and following guidelines will help you manage
legal and regulatory issues. The potential for substantial improvements in the quality
of life for those who are visually impaired and the rising need for assistive technology
make the market feasibility seem optimistic.

Prototyping, obtaining finance, and thorough project planning are the following
stages before moving on to full-scale development and testing. Effective cooperation
among many stakeholders, such as visually challenged communities, healthcare
professionals, and regulatory agencies, is important to ensure the triumphant
execution of this innovative navigation system.

3.1 Technological Viability

Two well-established fields—machine learning and computer vision—will be

integrated in this research. Considering the progress made in these domains, it is
technically possible to create a new navigation for those with visual impairments.

3.2 Economic Feasibility

The economic feasibility of the project depends on the cost of development,
production, and maintenance of the device. The long-term benefits such as improved
quality of life for visually impaired individuals and potential market demand make it
economically viable.

3.3 Possibility from a Legal Perspective

Laws and rules pertaining to accessibility, data privacy, and medical

2
6
 Department of Information Technology, NIELIT Agartala

equipment, among other things, must all be complied with by the project. The project
can proceed lawfully as long as these conditions are satisfied.

3.4 The feasibility of operations

To be operationally viable, the gadget has to be robust, lightweight, and easy to use. It
must be durable enough to endure frequent usage in a variety of settings, and it must
be simple to use and maintain.

3.5 Schedule Viability

Establishing a realistic timeframe is important because of the project's complexity.
Requirement analysis, system design, development, testing, deployment, and
maintenance all take time. Schedule feasibility refers to the project's ability to be
finished within the suggested time frame.

3.6 The Viability of the Market

People who are blind or visually handicapped have a high need for assistive devices.
The gadget has strong market viability if it can satisfy the demands of this market and
is reasonably priced.

2
7
 Department of Information Technology, NIELIT Agartala

Chapter 4
System Analysis

4.1 Introduction

The purpose of this system study is to offer a thorough investigation of the new
navigation system that is being suggested for the benefit of blind people. The system
combines cutting-edge technology to improve movement and independence,
including haptic feedback and computer vision. The architecture, essential factors to
enable successful design and execution, and system requirements are all included in
this examination.

4.1.1. Essential Functions

Navigation Guidance: To help users go from their current position to their
destination, provide real-time navigation information.

Obstacle Detection: Use computer vision to identify obstructions in the user's route
and warn them by providing haptic feedback.

Environment Recognition: Using haptic or aural cues, identify and alert users to
significant environmental elements (such as pedestrian crossings, traffic lights, and
entrances).

Route planning: Let users enter their locations, and the system will choose the best
routes taking accessibility into account.

Interface: Offer a user-friendly and easily navigable interface for selecting locations,
modifying preferences, and getting feedback.

4.1.2. Non-essential Conditions

Reliability: Guarantee accurate and consistent performance in a range

of settings.

28
 Department
Usability: Create a system that people of Information
with different levels of Technology, NIELIT
vision impairment Agartala
may
easily operate.

Scalability: Make room for upcoming improvements and the inclusion of new
features.

Battery Life: Reduce power usage as much as possible to ensure extended use.

Data privacy: Make sure that user data is safe and complies with privacy laws,
including location and personal data.

4.1.3. Hardware Components

Smartphone: A smartphone running the navigation application, equipped with
camera, and internet connectivity.

4.1.4. Software Components

Mobile Application: The core software that processes data, calculates routes, and
interfaces with the user.

Navigation Algorithms: Algorithms to determine the optimal path based on real-

time data and user preferences.

Computer Vision Module: Software to process camera input and detect obstacles
and landmarks.

4.1.5. Design with the user in mind

Accessibility: Ensuring that the interactions and interface are made so that people
with vision impairments may easily utilize them.

Customization: Giving consumers the ability to adjust the sensitivity and types of
input to suit their requirements and tastes.

4.1.6. Adaptability to Environment

Ensuring that the system functions well in both indoor and outdoor settings of use.

4.2 Data flow diagram

A Data Flow Diagram (DFD) is a graphical depiction that illustrates how data moves
and is processed through different parts of a system. The DFD for the innovative
29
 visually impaired navigator is shownDepartment of Information
below, along Technology,
with an overview of theNIELIT Agartala
key data
stores, data flows, and procedures.

Fig. 1. Level-0 Data Flow Diagram of a Novel

Navigator for Visually Impaired

4.1 Behavioral aspects of the system

Voice Commands: Voice commands reduce the requirement for visual interaction by
allowing users to engage with the system and input destinations.

Pre-set Destinations: Users have the option to store places they often visit for easy
access.
Audio Feedback: When an earbud or speaker is connected to the smartphone, spoken
navigation directions and notifications will be played back.

Make sure that all user data is secured and safely kept, including location and private
data. With the ability to remove history and adjust permissions, users will have
control over their data.

30
 . Chapter 5
Software Requirements
Specifications

This Software Requirements Specification (SRS) document aims to provide the

specifications needed to create a new navigation system for people with visual
impairments. The goal of this system is to increase freedom and mobility. There will
be a smartphone application that makes up the navigation system. The smartphone
software will manage navigational assistance, obstacle identification, and route
planning. This document includes the overall description of the system, specific
requirements, and appendices. It provides detailed information on the system's
functionality, performance, design constraints, and quality attributes.

5.1 General Description

5.1.1 Product Perspective

The navigation system is going to be a stand-alone device made especially for those
with vision impairments. There will be just one primary component to it: a
smartphone application for mobile devices.

31
 Department of Information Technology, Tripura
University

5.1.2 Product Functions

a) Guidance for real-time navigation.

b) Identification and warning of obstacles.

c) Planning and optimizing routes.

d) Recognizing the environment (such as pedestrian crossings and traffic signals).

e) User preferences that can be altered for feedback.

5.1.3 User Characteristics

a) People with visual impairments who want more independence.

b) Users having different levels of experience with technology.

5.1.4 General Constraints

a. Must adhere to accessibility guidelines.

b. Assure the security and privacy of data.

c. Keep your accuracy and dependability high in a variety of settings.

d. Boost battery life for extended periods of time.

5.1.5 Assumptions and Dependencies

a. Users' smartphones will be compatible.

b. Stable internet access for updates and initial configuration.

c. GPS accessibility enables precise location monitoring.

32
 Department of Information Technology, Tripura
University
5.1.6 Functional Requirements

The new navigation for visually impaired people is being developed, and this
document lays out the necessary functional criteria to make sure the application
satisfies the demands of its users and fulfils safety regulations.

5.1.7 Tracking Location

a. The user's current location will be tracked by the system via GPS.
b. Every five seconds, the system will update the location.

5.1.8 Direction Finding

a. The user will have access to route alternatives to their destination via the system.
b. In the event that the intended route is blocked, the system will provide alternate
routes.

5.1.9 Identifying Obstacles

a. The camera will be used by the system to identify obstructions in the user's route.
b. When the system detects an impediment within two meters, it will provide the user
with an auditory feedback notice.

5.1.10 Speech Guidance

a. The navigation system will offer spoken instructions.

b. The voice guiding system will handle several languages.

5.1.11 Help in an Emergency

a. An emergency button on the system will transmit the user's position to a designated
contact when touched.
b. An audio confirmation that the emergency alert has been dispatched will be provided
by the system.

5.1.12 User Input

a. Users will be able to score their navigational experience using the system.

33
 Department
b. The system will gather user input to ofprecision
increase the Information Technology, Tripura
of navigation.
University

5.2 External Interface Requirements

5.2.1 User Interfaces

a. For hands-free operation, voice instructions must be supported by the system.

b. Shows the emergency button, navigation choices, and current position.
c. Turn-by-turn directions, recognized impediments, and route information are
displayed on the navigation screen.
d. Users may choose languages, emergency contacts, and preferences on the Settings
screen.
e. Every action is accompanied by audible feedback from the system.

5.2.2 Hardware Interfaces

a. The GPS, camera, and microphone of the smartphone will all be interfaced with by
the system.
b. Headsets and other external Bluetooth devices must be supported by the system.
c. For real-time pathfinding and navigation, location updates are employed.

5.2.3 Software Interfaces

a. Map and location services APIs must be integrated with the system.

b. Secure APIs will be used by the system to communicate data.

34
 Chapter 6
System design

6.1 Introduction

An innovative smartphone application called "novel navigator for visually impaired users" helps users
navigate both inside and outdoor spaces. To provide real-time navigation, obstacle detection, and
auditory guiding, the system makes use of GPS, computer vision, and speech recognition technology.
Wide accessibility is ensured by the application's development for both the Windows and Android
platforms.

6.2 System Architecture

The system architecture is divided into several modules, each responsible for specific functionalities. The
key modules are:

a. User Interface (UI) Module

b. Location Tracking Module
c. Pathfinding Module
d. Obstacle Detection Module
e. Voice Guidance Module
f. Emergency Assistance Module
g. Data Management Module
h. Integration Module

35
 Department of Information Technology, Tripura
University

6.3 Module Design

6.3.1 User Interface (UI) Module

a. Module for User Interface (UI)

b. To give users a user-friendly and accessible interface.
c. Shows the emergency button, navigation choices, and current position.
d. Displays route information and any impediments found.
e. Permits emergency contacts and preferences to be customized.
f. Voice instructions and touch (big buttons) are used for user interaction.
g. Gives all user activities audible feedback.

6.3.2 Location Tracking Module

a. Use GPS to determine the user's present position.

b. Collects location information using the GPS hardware of the smartphone.
c. Calculates the user's current location by processing unprocessed GPS input.
d. Gives a location update every five seconds for the user.
e. Gives the pathfinding and obstacle detection modules access to location measurements.

6.3.3 Pathfinding Module

a. To determine and offer the best path to the user's destination.

b. Computes routes using map services.
c. Offers alternatives in the event that the main path is blocked.
d. Obtains the user's input on the destination.

6.3.4

36
 Department of Information Technology, Tripura
University

6.4 Algorithm design

6.5 System Maintenance

a. Regular updates will be provided to improve functionality and security.

b. User feedback will be continuously monitored and incorporated into future updates.
c. A dedicated support team will be available to assist users with any issues.

37
 Chapter 7
System Implementation

Describe the system set-up that is required for developing your solution, the components of your
deliverables, the system set-up that is required to deploy the solution, installation proce- dure, user
training requirements and status, testing of the system, trouble-shooting guidelines, guidelines for further
work.

7.1 Hardware Components

List the hardware units that have been selected for the system. Give little details such as - processor,
clock frequency, memory, hard-disk, cartridge drive, multi-media components (only if your system uses
them).

7.2 Software Environment

Describe the software features over which your system shall run which OS, which DBMS, etc.

38
 Department of Information Technology, Tripura University

7.3 System Development Platform

Describe the platform that have been used to develop the system. This includes, hardware units,
programming environment (including choice of compilers), DBMS, software development tools (e.g., front-
end tools), etc.

7.4 Project Accomplishment Status

Briefly state how much of the targeted scope could be accomplished, what are some critical aspects, if
any, that needs to be taken care of to complete any remaining part.

7.5 Guidelines for Continuation

Any guidelines that you seem necessary for others who may continue the work so as to ensure smooth
implementation.

7.6 Hardware Components

text here

7.7 Software Environment

Some text here

39
 Chapter 8
System Testing

System testing, a crucial stage of the software development lifecycle, involves testing the integrated,
whole program to make sure it satisfies the requirements. System testing will include functional,
usability, performance, security, and compatibility testing for the new navigation for visually impaired
users.

8.1 Test Plan

a. To confirm if the system satisfies the listed functional specifications.

b. To confirm the application's accessibility and usefulness for those with visual impairments.
c. To assess the system's dependability and performance in different scenarios.
d. To evaluate the security protocols put in place to safeguard user information and privacy.
e. To guarantee interoperability across many platforms and devices.

8.2 Test Cases

Details of individual tests to be carried out. This should specify system configuration for the test,
inputs to be given, outputs expected and persons involved.

40
 Chapter 9
Conclusion & Future Direction of
Work

9.1 Conclusion

Developing a novel and workable solution to improve the mobility and freedom of
people with visual impairments was the goal of the Novel Navigator for the Visually
Impaired project. Designing and building a model that can help people navigate their
surroundings safely and effectively is the goal of this project. The project effectively
combined a number of technologies, such as machine learning techniques,
TensorFlow, Python, and Keras, to offer real-time navigation support and feedback.

9.2 Future Direction of work

Significant progress has been achieved in improving the mobility and independence
of visually impaired people because to the Novel Navigator for the Visually Impaired
initiative. There are a lot of chances to improve the usefulness, impact, and
accessibility of the Novel Navigator for the Visually Impaired in the near future. by
concentrating on making, it possible for people to engage with their surroundings via
haptic feedback or voice instructions. The accuracy of object detection will be
increased by using machine learning models, which can then be converted into a
smartphone application.

41
References

[1] Isshita Borkar, Asma Shaikh, Snehal Jadhav, Vaishnavi Khandade, and Bhakti
Nagpure. Virtual assistant for the blind. 2022 international journal for research in
applied science engineering technology (ijraset). pages 2321–9653, IJRASET, 2022.
[2] Shubham Melvin Felix, Sumer Kumar, and A Veeramuthu. A smart personal ai
assistant for visually impaired people. In 2018 2nd international conference on trends
in electronics and informatics (ICOEI), pages 1245–1250. IEEE, 2018.
[3] Vinayak Iyer, Kshitij Shah, Sahil Sheth, and Kailas Devadkar. Virtual assistant
for the visually impaired. In 2020 5th International Conference on Communication
and Electronics Systems (ICCES), pages 1057–1062. IEEE, 2020.
[4] Hitakshi Jain, Anju V Kulkarni, et al. Survey on various techniques based on
voice assistance for blind. In 2023 International Conference on Intelligent Data
Communication Technologies and Internet of Things (IDCIoT), pages 600–605.
IEEE, 2023.
[5] Surya Chaitanya Jakka, Yerragopu Venkata Sai, A Jesudoss, et al. Blind
assistance system using tensor flow. In 2022 3rd International Conference on
Electronics and Sustainable Communication Systems (ICESC), pages 1505–1511.
IEEE, 2022.
[6] Praveen Kumar Maduri, Avinash Kaushal, Md Nurain Khan, Aman Kumar Rai,
Mohd Shahid Khan, and Chintakindi Sanjay Rameshwar. Realtime aid for blind using
python. In 2021 3rd International Conference on Advances in Computing,
Communication Control and Networking (ICAC3N), pages 1660–1664. IEEE, 2021.
[7] Sneha Rao and Vishwa Mohan Singh. Computer vision and iot based smart
system for visually impaired people. In 2021 11th International Conference on Cloud
Computing, Data Science & Engineering (Confluence), pages 552–556. IEEE, 2021.

Department of Information Technology, NIELIT Agartala

[8] P Shreya, N Shreyas, D Pushya, et al. Blind assist: a one stop mobile application
for the visually impaired. In 2021 IEEE Pune Section International Conference
(PuneCon), pages 1–4. IEEE, 2021.

42
[9] Tihomir Stefanov, Silviya Varbanova, and Milena Stefanova. An overview of
some popular devices and technologies designed for blind and visually impaired
people. In 2022 International Conference Automatics and Informatics (ICAI), pages
173–178. IEEE, 2022.
[10] Shailaja Uke, Hrishikesh Lokhande, Durva Lohar, Devansh Lathiya, Aditya
Langhe, Tanmay Lautawar, and Pranali Likhitkar. Virtual voice assistant in python
(friday). In 2022 IEEE 4th International Conference on Cybernetics, Cognition and
Machine Learning Applications (ICCCMLA), pages 164–167. IEEE, 2022.

43
 Appendix A
User Manual

Include user manual of your project here (if any). [Backup, operation log, trouble shooting.]

A.1 Installation Manual

A.2 Reference Manual

A.3 Maintenance Manual

44
Appendix B
Test Report

This should correspond to the Test cases already enlisted. Here record the observations, record
repetitions (due to unexpected test outcome and subsequent retry after any system correction)

45
 Appendix C
Input Output Formats

C.1 Paper Forms used in the Organisation

Attach copies of all existing paper input and output forms.

C.2 Input Forms in the New System

Attach copies of all forms designed in this project.

C.3 Output Formats in the New System

Attach copies of all output reports with test data.

46
 Appendix

D
Source Code

import cv2
import numpy as np
import pyttsx3

# Function to perform background subtraction

def perform_background_subtraction(frame, background):
# Convert frames to grayscale
gray_frame = cv2.cvtColor(frame, cv2.COLOR_BGR2GRAY)
gray_background = cv2.cvtColor(background, cv2.COLOR_BGR2GRAY)

# Calculate absolute difference between the background and current frame

diff = cv2.absdiff(gray_background, gray_frame)

# Apply simple thresholding to get binary image

_, thresh = cv2.threshold(diff, 30, 255, cv2.THRESH_BINARY)

return thresh

# Function to calculate length and width of object

def calculate_dimensions(contour, pixel_cm_ratio):
# Get bounding rectangle
x, y, w, h = cv2.boundingRect(contour)

# Calculate length and width of object in cm

length_cm = w / pixel_cm_ratio
47
 width_cm = h / pixel_cm_ratio

return length_cm, width_cm

# Load Cap
cap = cv2.VideoCapture(0)
cap.set(cv2.CAP_PROP_FRAME_WIDTH, 1280)
cap.set(cv2.CAP_PROP_FRAME_HEIGHT, 720)

# Initialize background
_, background = cap.read()

# Initialize pyttsx3 engine

engine = pyttsx3.init()

while True:
_, img = cap.read()

# Perform background subtraction

mask = perform_background_subtraction(img, background)

# Find contours in the mask

contours, _ = cv2.findContours(mask, cv2.RETR_EXTERNAL,
cv2.CHAIN_APPROX_SIMPLE)

obstacle_detected = False

# Draw objects boundaries and calculate dimensions

if contours:
for cnt in contours:
# Calculate contour area
area = cv2.contourArea(cnt)

# Filter contours based on area

if area > 1000: # Adjust the area threshold as needed
# Calculate pixel to cm ratio based on object's bounding rectangle
perimeter = cv2.arcLength(cnt, True)

48
 pixel_cm_ratio = perimeter / 20 # Assuming ArUco marker size is 20 cm

# Calculate length and width of object

length_cm, width_cm = calculate_dimensions(cnt, pixel_cm_ratio)

# Get bounding rectangle

x, y, w, h = cv2.boundingRect(cnt)

# Display rectangle and dimensions

cv2.rectangle(img, (x, y), (x + w, y + h), (255, 0, 0), 2)
cv2.putText(img, f"Length: {length_cm:.2f} cm", (x, y - 10),
cv2.FONT_HERSHEY_SIMPLEX, 0.6, (0, 255, 0),
2)
cv2.putText(img, f"Width: {width_cm:.2f} cm", (x, y - 30),
cv2.FONT_HERSHEY_SIMPLEX, 0.6, (0, 255, 0),
2)

# Check if object is obstructing the view

if y < 100: # Adjust the threshold as needed
obstacle_detected = True

# Speak obstacle status

if obstacle_detected:
cv2.putText(img, "Obstacle Detected!", (50, 50),
cv2.FONT_HERSHEY_SIMPLEX, 1, (0, 0, 255), 2)
engine.say("Obstacle Detected!") # Convert text to speech
engine.runAndWait()
else:
cv2.putText(img, "No Obstacle", (50, 50), cv2.FONT_HERSHEY_SIMPLEX,
1, (0, 255, 0), 2)

cv2.imshow("Image", img)
key = cv2.waitKey(1)
if key == 27:
break

cap.release()
cv2.destroyAllWindows()

49