Hardware Model-Based Traffic Sign Detection and Recognition
Hardware Model-Based Traffic Sign Detection and Recognition
Abstract
In the modern world, correctly recognizing and B+, Embedded System, Convolution Neural
categorizing traffic signs is essential for Network (CNN), Image Processing, Real-time
improving road safety and enabling autonomous Classification, Smart Vehicle System, Traffic
driving technologies. This study uses the Monitoring.
Raspberry Pi 3 Model B+ as the central
processing unit to provide a hardware-based, I. Introduction
real-time method for traffic sign detection and These days, advanced driver assistance systems
recognition. (ADAS) are an essential component of modern
Our system integrates image collection, cars, especially when it comes to identifying
preprocessing, and classification into a small, and comprehending traffic signs, which is a
embedded device intended for realistic, real- crucial area of visual computing [1]. Road signs
world deployment, in contrast to conventional provide vital information like speed limits,
software-heavy approaches. The system makes directions, and cautions that assist drivers in
use of a lightweight Convolutional Neural making safe and educated decisions. They act as
Network (CNN) to effectively categorize traffic a kind of global language on the road. Drivers
signs, employs a camera module to gather visual can improve their navigation skills, steer clear
data, and applies image enhancement techniques of possible dangers, and help create a safer and
to improve clarity. The CNN is perfect for low- more efficient traffic flow by correctly
power devices like the Raspberry Pi since it is interpreting these signs [2].
tuned to balance speed and accuracy. The effectiveness of traffic signs is greatly
Our test demonstrates that the system can influenced by their visual design.
accurately identify and detect a variety of traffic Characteristics like shape and color aren’t just
signs in a range of environmental and lighting aesthetic—they’re critical for fast recognition.
situations. All things considered, this study Most countries follow standardized patterns
provides a scalable, economical, and energy- using specific colors (like red, blue, and yellow)
efficient solution for intelligent automobiles and and shapes (such as circles, triangles, and
smart traffic systems. In order to achieve even rectangles) to ensure uniformity and quick
greater performance, future advancements will understanding across different regions. These
concentrate on increasing recognition accuracy visual cues help both humans and machines
using more sophisticated deep learning models identify signs quickly, even at a glance.
and utilizing cutting-edge AI technology. However, conditions on the road are rarely
perfect. Factors such as poor weather, low light,
Keywords or worn-out signage can make it difficult to see
Traffic Sign Detection & Recognition, and interpret road signs clearly. These
Autonomous Navigation, Raspberry Pi 3 Model challenges highlight the need for reliable and
network according to the sign’s shape and RGB techniques, this integrated strategy performed
color properties. better, making it more practical.
A different study [10] employed a multi-layer Processed images were stored in the Portable
perceptron neural network, which was trained Pixel Map (PPM) format without compression.
on a dataset containing 2,880 images. This Each image was carefully annotated to indicate
model was further tested on 1,233 images of the presence and type of visible traffic signs. All
speed limit signs, achieving an accuracy rate of label information, including class identifiers and
92.4%. However, the research did not specify bounding box data, is compiled in a structured
whether the same traffic sign instances were CSV file to support supervised learning models.
repeated across different image groups.
Another method [11] utilized a dataset B. Dataset Characteristics and Relevance to
containing 1,300 pre-processed images from six the Proposed System
categories five corresponding to speed limits In the present work, the GTSRB dataset [20] is
and one representing noise. The study tested adopted as a benchmark to train and validate the
various segmentation-based techniques using traffic sign classification model due to its
binary image processing. Additionally, research comprehensive structure and real-world
in [12] compiled an extensive dataset featuring diversity. The dataset comprises over 50,000
36,000 images of Spanish traffic signs from 193 annotated images categorized into 43 distinct
classifications, leveraging pictogram traffic sign classes. It presents a wide range of
identification techniques. A different approach visual variations, including differences in
[13] explored the use of histogram features and orientation, illumination levels, weather
Region of Interest (ROI) extraction for traffic conditions, partial occlusions, and spatial
sign recognition. However, the results obtained positioning of signs within each frame—factors
in this study were below expectations, with the that closely resemble real-time driving
proposed methodology failing to achieve the environments.
desired performance levels. The complete dataset includes 51,840 images,
A direct comparison of the studies mentioned with dimensions ranging from 15×15 to
above is difficult, as many of them utilized 250×250 pixels. The traffic signs within these
proprietary datasets, restricting accessibility for images are not consistently centered, which
validation by other researchers. To address this introduces natural complexity for detection
challenge, a study in [14] applied the publicly tasks. The dataset is systematically divided into
available GTSRB dataset to develop a novel two parts: 39,209 images are reserved for
Convolutional Neural Network (CNN)-based training, while the remaining 12,630 images
architecture for traffic sign detection and form the testing set. To prevent data leakage,
classification. Faster R-CNN for multi-object images containing the same physical sign are
recognition was used in another study [15], confined to a single subset. Additionally, a
which included various datasets with small portion of the training data is allocated for
automobiles, traffic signs, and traffic lights. model validation and performance tuning.
CNNs were used by the authors in [16] to create Each image is linked to a specific traffic sign
a technique specifically intended for identifying label, such as "Speed Limit 50 km/h," "Speed
Indian traffic signs. Building on this, a real-time Limit 60 km/h," or "Road Work." The traffic
detection system that can detect both audio and signs are divided into four primary categories—
video was developed in another study [17]. It Warning, Prohibitory, Mandatory, and
analyzes auditory cues using the VGG model Others—in order to better arrange them and
and uses YOLOv5 to identify indications in make them easier to use with various
video data. When compared to earlier recognition algorithms. Sample photos from
compatible with the OS thanks to its Linux The OS is installed by flashing the image file
foundation. onto a microSD card using the official
It has a Camera Serial Interface (CSI) connection. Raspberry Pi Imager tool.
Clear images may be captured with this camera For this project, a 32GB SanDisk microSD
even in a variety of lighting situations. The Raspbian card was chosen to provide enough storage for
OS (based on Debian) that the Raspberry Pi runs on the operating system, necessary dependencies,
offers a reliable environment for executing Python
scripts and necessary libraries like OpenCV and
TensorFlow Lite, which are both utilized in this
study to identify and categorize traffic signs.
Fig. 11 (B). Output image showing Fig. 12 (A). Output image showing
Detected: Stop Left (59.28%)
Detected: Left
[10] Lu Wei, Lu Runge, Liu Xiaolei, "Traffic on pictogram identification for the road-sign
sign detection and recognition via transfer recognition task using SVMs,” ELSEVIER
learning," 2018 Chinese Control and Decision Computer Vision and Image Understanding,
Conference (CCDC), Shenyang, China, 2018, March 2010, Volume 114, Issue 3, pp. 373–383.
pp. 5884-5887. [18] Ming Liang, Mingyi Yuan, Xiaolin Hu,
[11] Yuan Yuan, Zhitong Xiong, Qi Wang, Jianmin Li and Huaping Liu, "Traffic sign
"VSSA-NET: Vertical Spatial Sequence detection by ROI extraction and histogram
Attention Network for Traffic Sign Detection," features-based recognition," The 2013
in IEEE Transactions on Image Processing, July International Joint Conference on Neural
2019, vol. 28, no. 7, pp. 3423-3434. Networks (IJCNN), Dallas, TX, USA, 2013, pp.
[12] C. Bahlmann, Y. Zhu, Visvanathan 1-8.
Ramesh, M. Pellkofer and T. Koehler, "A [19] R. Karthika, Latha Parameswaran, “A
system for traffic sign detection, tracking, and novel convolutional neural network-based
recognition using color, shape, and motion architecture for object detection and recognition
information," IEEE Proceedings. Intelligent with an application to traffic sign recognition
Vehicles Symposium, 2005., Las Vegas, NV, from road scenes”, Pattern Recognition and
USA, 2005, pp. 255-260. Image Analysis, July 2022, Volume 32, pp. 351-
[13] Fabien Moutarde, Alexandre Bargeton, 362.
Anne Herbin and Lowik Chanussot, "Robust on- [20] Kaushek Kumar T R, S Thiruvikkraman,
vehicle real-time visual detection of American Gokul R, Nirmal A and Karthika R, "Evaluating
and European speed limit signs, with a modular the Scalability of a Multi-Object Detector
Traffic Signs Recognition system," 2007 IEEE Trained with Multiple Datasets," 2021 5th
Intelligent Vehicles Symposium, Istanbul, International Conference on Intelligent
Turkey, 2007, pp. 1122-1126. Computing and Control Systems (ICICCS),
[14] Alberto Broggi, Pietro Cerri, Paolo Medici, Madurai, India, 2021, pp. 1359-1366.
Pier Paolo Porta, and Guido Ghisio, "Real Time [21] Rajesh Kannan Megalingam, Kondareddy
Road Signs Recognition," 2007 IEEE Intelligent Thanigundala, Sreevatsava Reddy Musani,
Vehicles Symposium, Istanbul, Turkey, 2007, Hemanth Nidamanuru and Lokesh Gadde,
pp. 981-986. "Indian traffic sign detection and recognition
[15] Christoph Gustav Keller, Christoph using deep learning", International Journal of
Sprunk, Claus Bahlmann, Jan Giebel and Transportation Science and Technology,
Gregory Baratoff, "Real-time recognition of Volume 12, Issue 3, 2023, pp. 683-699.
U.S. speed signs," 2008 IEEE Intelligent [22] V Sowbaranic Raj, Jalakam Venu Madhava
Vehicles Symposium, Eindhoven, Netherlands, Sai, N A Lakkshmi Yogesh, SB Kavya Preetha
2008, pp. 518-523. and Lavanya R, "Smart Traffic Control for
[16] Azam Sheikh Muhammad, Niklas Emergency Vehicles Prioritization using Video
Lavesson, Paul Davidsson, Mikael Nilsson, and Audio Processing," 2022 6th International
“Analysis of speed sign classification Conference on Intelligent Computing and
algorithms using shape-based segmentation of Control Systems (ICICCS), Madurai, India,
binary images”, International Conference on 2022.
Computer Analysis of Image and Patterns
(CAIP), Lecture Notes in Computer Science
(LNIP), Volume 5702, pp. 1220-1227, 2009.
[17] S. Maldonado Bascon, J. Acevedo
Rodriguez, S. Lafuente Arroyo, A. Fernández
Caballero, F. Lopez-Ferreras, “An optimization