final - Copy
final - Copy
Submitted by
Bhoomika L B 4MC22CI008
Pratham M jain 4MC22CI023
Rakshitha K S 4MC22CI024
Karthik M L 4MC23CI400
Chapter 1
Introduction
1.1 Overview
In today’s fast-paced education environment, time management and accuracy are critical factors
in ensuring the smooth functioning of classrooms. Traditionally, attendance in classrooms is
marked manually, which is not only time-consuming but also prone to human errors and
manipulation, such as proxy attendance. Technologies like RFID and fingerprint recognition
have been employed to automate the process, but they require physical interaction, which may
disrupt the flow of a class. Moreover, such systems can be slow when handling large numbers
of students. Facial recognition technology offers a non-intrusive solution, providing a seamless
way to record attendance automatically without manual input. With advancements in machine
learning and deep learning, facial recognition systems have become more accurate, even in real-
time scenarios.
This report discusses the development of an Automatic Attendance Recorder using facial
recognition technology to efficiently record students' attendance in real time. The system will
use video feeds to detect and recognize students' faces, marking their attendance automatically
and allowing them to view their attendance status online. Fig 1.1 illustrates a "Smart Classroom
with Real-Time Facial Recognition for Automated Attendance," highlighting how this
technology seamlessly integrates into the classroom environment and enables accurate,
automated attendance marking.
Fig 1.1 Smart Classroom with Real-Time Facial Recognition for Automated Attendance
1. Ahmed et al. [1] introduced an intelligent attendance system utilizing convolutional neural
networks (CNN) for real-time face identification of students, addressing the inefficiencies of
manual attendance methods. Their system integrates face detection, identification, and
counting by employing the Histogram of Oriented Gradients (HOG) algorithm for detecting
faces, a CNN for extracting facial features, and a Support Vector Machine (SVM) for
classification. Additionally, a Haar cascade classifier is used for face counting. The system
achieved a high classification accuracy of 99.75%, demonstrating its effectiveness in small-
scale settings such as lecture halls. The authors emphasize that this automated approach
significantly reduces time and effort while enhancing attendance tracking accuracy.
2. Al-Amoudi et al. [2] developed an automatic attendance system using face recognition with
deep learning algorithms to streamline attendance processes. The system comprises three main
components: the attendance tracking module, student profile management, and a training phase.
For face detection, Multi-Task Cascaded Convolutional Neural Networks (MTCNN) are
employed, while FaceNet handles face recognition. After capturing images of students during
class, the system processes attendance data and stores it in an Excel sheet, providing a practical
and accessible solution for educational institutions. Tested on 908 training images and 108
testing images, the system achieved 100% accuracy in face detection and 87.03% in face
recognition, proving both its reliability and cost-effectiveness by requiring no additional
hardware.
3. Rahman et al. [3] introduced a biometric attendance system that employs fingerprint
recognition to accurately monitor attendance. The system uses a fingerprint scanner to capture
and match individuals’ fingerprints against pre-registered templates, ensuring secure and
precise identification. To enhance transparency, a GSM feature is integrated, which sends
automated notifications to guardians, providing real-time updates on attendance. This
fingerprint-based approach significantly reduces errors associated with traditional methods like
4. Shrivastava et al. [4] developed an IoT-based attendance monitoring system using RFID
technology, Arduino ESP8266, and Adafruit.io to streamline student attendance tracking within
a designated area. The system automates attendance by employing RFID cards and a scanner
to capture student information, which is then uploaded to the Adafruit cloud, enabling real-time
access to attendance records. This approach significantly reduces the errors and inefficiencies
of traditional methods, providing an easy-to-use, efficient solution. The authors emphasize that
through the integration of IoT, educational authorities can remotely monitor student presence
and access comprehensive attendance statistics, enhancing the overall management process.
5. Akhilesh et al. [5] presented a real-time attendance management system that leverages facial
recognition to streamline attendance tracking during lectures. Utilizing deep learning
techniques, the system detects and recognizes student faces in real-time, automating the
attendance process. A frontal face detector identifies students, and the recognized faces are
recorded in an Excel sheet. The system’s training phase is conducted on Google Colab, and it
employs cosine similarity for face matching against pre-stored data. This approach provides a
hands-free and efficient solution, addressing limitations of traditional and biometric methods,
such as fingerprint or RFID systems, for use in educational and organizational settings.
The current attendance recording systems suffer from various limitations, including:
• Time Inefficiency: Manual attendance methods waste valuable class time, especially
in large classrooms.
• Inaccuracies and Proxy Attendance: There is potential for human error and proxy
attendance in manual systems, leading to false records.
• Physical Wear and Tear: Biometric systems like fingerprint readers require contact,
which can degrade over time and pose hygiene concerns, especially post-pandemic.
• Student Disruption: Methods requiring active student participation (scanning cards or
fingerprints) can disrupt the classroom.
The need for a more automated, non-intrusive, and efficient system is evident, and facial
recognition offers the potential to overcome these issues while providing an accurate and
scalable solution.
1.4 Objectives
• The so lution will automatically log attendance based on recognized faces, eliminating
the need for manual roll calls. This feature will save valuable instructional time and
minimize the likelihood of human error in attendance tracking.
• Attendance data will be securely stored in a centralized database, ensuring that records
are maintained accurately and protected against unauthorized access.
• Implement security measures such as encryption, user authentication, and access
controls to safeguard sensitive information, complying with relevant data protection
regulations.
• Develop an intuitive web or mobile application interface that allows students and faculty
to easily manage and view attendance records.
• The application will enable faculty to generate reports, track attendance trends, and send
notifications to students regarding their attendance status.
The Proposed Method for the Automatic Attendance Recorder includes the following
components:
• Each student’s facial data will be captured during registration and stored in a secure
database. The system will use this data to match recognized faces with the
corresponding student profiles and mark attendance.
3. Attendance Marking:
• Upon successful recognition of a student's face, the system will automatically update
their attendance status for the respective class session.
• The system will handle multiple students entering or leaving the classroom at different
times by continuously monitoring the video feed.
4. User Interface:
• A simple and intuitive web interface will be provided for students and faculty. Students
can view their attendance records, while faculty can monitor attendance statistics.
• The system will also generate reports for administrators or faculty, summarizing
attendance records over a specific time frame.
For real-time facial recognition, the following deep learning models will be considered:
• FaceNet: A deep learning model that converts faces into 128-dimensional embeddings.
FaceNet has been widely used in facial recognition tasks for its accuracy and speed.
• YOLOv5: A real-time object detection model that can detect faces along with other
objects. YOLO can be used for multi-object recognition if attendance needs to be
integrated with other classroom tasks.
• Hardware: A webcam for capturing video feeds, and a server or a powerful PC for
running the deep learning models in real-time.
Fig 1.2 illustrates the Flowchart of the Automatic attendance recorder using Facial Recognition
and how it works.
2. Face Detection: Detect faces in the video using the detection model.
3. Face Recognition: Compare detected faces with the stored embeddings in the database.
4. Attendance Marking: Update the attendance status for the recognized students.
Fig 1.2 Flowchart of the Automatic attendance recorder using Facial Recognition
Chapter-1: Introduction
This chapter provides an overview of the project, highlighting the importance of automating
attendance systems. It includes a literature survey summarizing related works and identifying
gaps in existing solutions. The problem statement defines the issues addressed by this project,
while the methodology outlines the approach taken. Finally, this section explains the report's
structure to guide the reader through the study.
This chapter describes the technical implementation of the system. It begins with a block
diagram illustrating the system's architecture and workflow. The algorithm section details the
step-by-step processes used for facial recognition and attendance marking. Additionally, a
flowchart is included to visually represent the sequence of operations involved in the system,
from data input to attendance report generation.
This chapter discusses the experimental setup, including the tools and technologies employed,
as well as the dataset used for testing the system. The dataset is described in detail, covering
the number of samples, preprocessing techniques, and sources. Results are presented through
performance metrics such as accuracy, precision, recall, and confusion matrix analysis.
Comparisons with existing solutions highlight the advantages of the proposed system, and
visual representations such as graphs are included to support the discussion.
This chapter concludes the study by summarizing the project’s key contributions and findings.
It highlights the effectiveness and practical applications of the system. Limitations encountered
during the study are discussed, followed by potential future enhancements, such as improving
recognition accuracy in low-light conditions, scaling the system for larger datasets, and
integrating additional features like mobile application support. It including research papers,
books, and other resources that informed the development and evaluation of the system.
Chapter 2
Methodology
The project integrates facial recognition algorithms with real-time attendance tracking. The
methodology includes face detection using Haar Cascade, feature extraction with FaceNet, and
classification via SVM. The system securely stores student details, captures images for training,
and compares real-time images during class to mark attendance.
Fig 2.1 illustrates the Block Diagram of the Automatic attendance recorder using Facial
Recognition and how this methodology works.
• The system begins with a secure login interface accessible only to authorized teachers.
• The teacher logs in using unique credentials, ensuring that the attendance data remains
secure and cannot be accessed or manipulated by unauthorized personnel.
• During the registration phase, the teacher inputs each student's details, such as their
unique student number (USN), name, branch, gender, contact number, and email
address.
• Multiple photos of each student are captured from different angles to build a robust
dataset. These photos are preprocessed and stored in the system for training the facial
recognition model.
• This block ensures the creation of a comprehensive database for accurate identification.
3. Face Detection and Embedding Extraction Using Haar Cascade and FaceNet
• Face Detection:
o The Haar Cascade algorithm is used to detect faces in the input images or video
streams. It identifies the location of faces within a frame and crops the face
region for further processing.
• Embedding Extraction:
• During the attendance session, the system activates a live camera feed to capture real-
time images of students in the classroom.
• The live images undergo preprocessing, including face detection and embedding
extraction, using the same techniques applied during registration.
• This step ensures that the system continuously monitors and processes student images
in real time.
• The embeddings extracted from the live images are compared with the stored
embeddings in the database.
• A Support Vector Machine (SVM) classifier determines whether a live face matches
any of the stored embeddings.
• This ensures accurate and real-time attendance marking, eliminating manual errors and
proxy attempts.
• Once attendance marking is complete, the system generates detailed attendance reports.
• These reports include information such as the student’s name, USN, class name, date,
time, and attendance status (Present/Absent).
Fig 2.1 Block Diagram of Automatic Attendance recorder using facial recognition
o Unique Student Number (USN), name, branch, gender, contact number, and
email address.
Extract 128-dimensional embeddings for each detected face using the FaceNet model.
o Compare the extracted embeddings with the stored database using SVM
o Include details: student name, USN, class name, date, and attendance status
(Present/Absent).
2.2 Flowchart
Start
Teacher Login
Yes
No
Is Login
Successful?
Register Students
Capture Real-Time
Images During
Class
Compare
Embeddings with
Database (SVM)
Yes
Mark as Present
Does Face
Match?
Mark as Absent
No
Generate Attendance
Report
End
Chapter 3
1. Dataset Collection
The first step in the experimental setup involves creating a comprehensive dataset to train and
test the system.
• During the registration phase, facial images of each student were collected from
various angles to capture diverse facial features.
• Images include variations such as:
Different lighting conditions (e.g., bright light, dim light).
Changes in pose (e.g., front-facing, slight head tilts).
Expressions (e.g., neutral, smiling).
2. Preprocessing
Before using the dataset, the images undergo preprocessing to standardize and enhance their
quality.
• Image Resizing:
o All images are resized to a fixed resolution (e.g., 224x224 pixels) to meet the
input requirements of the FaceNet model.
• Image Enhancement:
o Normalization: Pixel values are normalized to a standard scale (e.g., 0–1) for
faster convergence during embedding generation.
o The algorithm scans the image using a sliding window approach and identifies
faces based on pre-defined Haar-like features (e.g., edges, lines).
o This ensures that only the relevant face regions are cropped and sent for
further processing.
2. FaceNet (facenet_keras.h5)
o These embeddings act as unique identifiers for faces and are stored in the
database for recognition.
The hardware and software used are critical for ensuring smooth processing and real-time
performance.
Hardware Setup
Software Setup
OpenCV: For face detection and image preprocessing using Haar Cascade.
• Training Dataset
• Testing Dataset
o Images captured during live attendance sessions are used to test the system’s
recognition performance.
3.2.1 Results
1. Functionality
o For each detected student, the system matches the face against the database
and records attendance automatically.
2. Attendance Report
• Storage in Database:
o Each session is recorded with a unique session ID, allowing retrieval of past
attendance records.
o The teacher or admin logs into the system and selects the desired attendance
session to view or download the report.
o Reports can be exported in formats such as PDF, Excel, or CSV for easy
sharing or printing.
Sharing Reports
• Email Integration:
o After generating the report, the system can email it to authorized personnel
(e.g., the class teacher or head of the department).
o If integrated with a mobile application, teachers can view and share reports
directly from their devices.
3.2.2 Discussion
o The system eliminates the need for manual attendance, saving time and effort.
2. Challenges Faced:
o Similar Faces: Students with similar facial features might occasionally cause
recognition difficulties.
o Expand the training dataset with diverse face samples to improve robustness.
4. Future Enhancements:
Chapter 4
4.1 Conclusion
The future scope of the project lies in improving the system's scalability, usability, and
robustness to handle real-world scenarios more effectively. Here are the detailed opportunities
for enhancement:
o Benefits:
o Proposed Solutions:
o Facial Emotion Detection: The system can also analyze student engagement
by detecting emotions like attentiveness or boredom during classes.
References
[1] Ahmed, M. A., Salman, M. D., & Alsharida, R. A. (2022). An intelligent attendance
system based on convolutional neural networks for real-time student face identifications.
Vol. 17, No. 5, pp. 3326-3341.
[2] Al-Amoudi, I., Samad, R., Abdullah, N. R. H., Mustafa, M., & Pebrianti, D. (2022).
Automatic attendance system using face recognition with deep learning algorithm. In:
Advances in Science, Technology & Innovation (Vol. 981, pp. 44). DOI: 10.1007/978-
981-16-2406-3_44
[3] Rahman, Md. S., Rumman, K. M., Ahmmed, R., Abdur Rahman, Md., & Sarker, Md. A.
(2023). Fingerprint based biometric attendance system. European Chemical Bulletin, 12,
Section A. DOI: 10.31838/ecb/2023.12.s3.026