Scribd
Upload
113 views

Data Engineering Syllabus

Data Engineering syllabus

Uploaded by

Himanshu Sharma
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
113 views

Data Engineering Syllabus

Data Engineering syllabus

Uploaded by

Himanshu Sharma
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 5

Course Curriculum (w.e.f.

Session 2024-25)
B.Tech CSE (AIML)

BCSC XXXX: DATA ENGINEERING


Objective:

To introduce first-year undergraduate students to the fundamental concepts, techniques, and


tools used in data engineering, preparing them for handling and managing large-scale data
systems.

Credit: 2 L–T–P: 2–0–0

Module Content Teaching


No. Hours
Introduction to Data Engineering: Overview of Data Engineering: Definition,
Importance, and Applications.
Data Engineering Lifecycle: Data Generation, Collection, Storage, Processing,
and Analysis, The Role of a Data Engineer.
Data Collection: Sources of Data, Data Lake, Batch Processing, Streaming, Web
I Scraping, APIs and Data Extraction. 20
Data Modeling: Concepts, E-R Diagrams, Normalization and denormalization,
OLAP, OLTP
Data Storage: Relational Databases. NoSQL Databases. Data Warehouses.
Data Processing and Transformation: ETL (Extract, Transform, Load)
Processes
Data Cleaning Techniques- Batch Processing vs. Stream Processing
Data Integration: Combining Data from Multiple Sources. Data Integration
Tools. Data Quality and Consistency
Data Pipelines: Designing and Implementing Data Pipelines. Workflow
II Orchestration Tools (e.g., Apache Airflow). Monitoring and Maintaining Data 20
Pipelines
Data Security and Privacy: Ensuring Data Security. Data Encryption
Techniques. Compliance with Data Privacy Regulations

Textbooks:
 Data Engineering with Python by Paul Crickard.
 Fundamentals of Data Engineering by Joe Reis and Matt Housley.
Reference Books:
 The Data Warehouse Toolkit: The Definitive Guide to Dimensional Modeling by Ralph
Kimball and Margy Ross.
 Designing Data-Intensive Applications by Martin Kleppmann.
 Big Data: Principles and Best Practices of Scalable Real-Time Data Systems by Nathan Marz
and James Warren.

Outcome:
Upon completion of the course, students will:
 CO1: Understand the basics and importance of data engineering.
 CO2: Learn different data models and schema design techniques.
 CO3: Gain proficiency in data integration and ETL processes.
 CO4: Explore and use various big data technologies and tools.
 CO5: Apply data engineering concepts to real-world scenarios.

COs POs/PSOs

DEPARTMENT OF COMPUTER ENGINEERING & APPLICATIONS, Institute of Engineering & Technology


Course Curriculum (w.e.f. Session 2024-25)
B.Tech CSE (AIML)

CO1 PO1, PO2 / PSO1


CO2 PO3, PO4 / PSO2
CO3 PO5, PO6 / PSO3
CO4 PO1, PO3 / PSO1
CO5 PO2, PO4 / PSO2
CO6 PO7, PO8 / PSO4

DEPARTMENT OF COMPUTER ENGINEERING & APPLICATIONS, Institute of Engineering & Technology


Course Curriculum (w.e.f. Session 2024-25)
B.Tech CSE (AIML)

BCSE XXXX: DATA ENGINEERING LAB


Objective: To provide practical experience in implementing data engineering techniques
and tools using Python and other relevant technologies.

Credits: 2 L-T-P-J: 0-0-4-0

Module Content Teaching


No. Hours

1. Data modeling using ER diagram


2. Data preprocessing – Cleaning data, noise elimination,
feature selection and dimension reduction
3. Schema design for OLAP and OLTP
4. ETL Pipeline implementation- Extract data from various
sources. Transform data using cleaning, aggregation, and
enrichment techniques. Load data into different storage
I solutions. 20
5. Building ETL Pipelines – Extracting data from API and
databases
6. Data Transformation
7. Setting up AirFlow
8. Creating Directed Acyclic Graph using AirFlow
9. Data cleaning
10. Data storage using NoSQL

Textbooks:

 Data Engineering with Python by Paul Crickard.


Reference Books:

 Designing Data-Intensive Applications by Martin Kleppmann.


 Python Data Science Handbook by Jake VanderPlas.
 Hadoop: The Definitive Guide by Tom White.
Outcome:

Students will be able to:

 CO1: Use SQL for database management.


 CO2: Design and implement effective database schemas.
 CO3: Perform ETL operations to manage data flows.
 CO4: Utilize big data frameworks and tools for data processing.
 CO5: Create and manage data pipelines using orchestration tools.

DEPARTMENT OF COMPUTER ENGINEERING & APPLICATIONS, Institute of Engineering & Technology


Course Curriculum (w.e.f. Session 2024-25)
B.Tech CSE (AIML)

DESIGN THINKING
Objective: The objectives of this course are to:
1. To impart knowledge on design thinking process for understanding complex designs.
2. To provide design skills to analyze design thinking issues and apply the tools and techniques of design.
3. To use design thinking concept in product development.

Credits: 03 L–T–P-J: 3–0–0-0

Module
Content Hours
No.
- Understand the fundamentals of design thinking methodology
- Learn about the design thinking process and its importance in problem-solving
- Explore techniques for empathizing with users or stakeholders to understand
their needs and challenges
- Conduct interviews, observations, and surveys to gather insights
- Define the problem statement based on insights gathered during the empathize
phase
I 20
- Reframe the problem to ensure clarity and alignment with user needs
- Generate creative ideas and solutions through brainstorming sessions
- Encourage divergent thinking and exploration of multiple possibilities
- Build prototypes to visualize and communicate ideas
- Use low-fidelity prototypes such as sketches or paper prototypes, and iterate
based on feedback

Test prototypes with users to gather feedback and insights


- Iterate on designs based on user feedback and refine solutions
- Explore strategies for implementing design solutions
- Collaborate with stakeholders to bring solutions to life
- Consider scalability and long-term viability of design solutions
II - Evaluate the impact of design thinking processes on outcomes 20
- Study real-world examples of successful design thinking projects
- Analyze the design process, challenges faced, and lessons learned
- Work on hands-on projects to apply design thinking methodologies
- Solve real-world problems using the design thinking process

Text Book:
 Karmic Design Thinking by Prof. Bala Ramadurai, available at Amazon (paperback), Flipkart,
halfpricebooks.in
 S. Salivahanan, S.Suresh Kumar, D.Praveen Sam, “Introduction to Design Thinking”, Tata Mc Graw
Hill, First Edition, 2019.
 Kathryn McElroy, “Prototyping for Designers: Developing the best Digital and Physical Products”,
O’Reilly, 2017.

Reference Books:
 Michael G. Luchs, Scott Swan, Abbie Griffin, ”Design Thinking –New Product Essentials from
PDMA”, Wiley, 2015.
 Vijay Kumar, “101 Design Methods: A Structured Approach for Driving Innovation in Your
Organization”, 2012.
 The Design of Everyday Things by Don Norman, 2013 Available on Amazon.
 The Mom Test: How to talk to customers & learn if your business is a good idea when everyone is
lying to you, Rob Fitzpatrik.

Outcome: After completion of course, student will be able to:

DEPARTMENT OF COMPUTER ENGINEERING & APPLICATIONS, Institute of Engineering & Technology


Course Curriculum (w.e.f. Session 2024-25)
B.Tech CSE (AIML)

 CO1: Analyze design thinking concepts and principles to perform human centered design process
for creative problem solving.
 CO2: Create empathy maps to visualize user attitudes and behavior for gaining insights of
customers.
 CO3: Develop innovative products or services for a customer base using ideation techniques.
 CO4: Build & improve product by implementing concept of design thinking.
 CO5: Apply different methodology & framework for product development.
 CO6: Improve product features, UI/UX to increase user retention and engagement.

DEPARTMENT OF COMPUTER ENGINEERING & APPLICATIONS, Institute of Engineering & Technology

You might also like