Scribd
Upload
161 views

Data Engineering Study Plan

The document outlines a 20-week study plan to become a data engineer. It is divided into weekly topics that cover fundamental programming concepts, Python, databases, data manipulation with Pandas, big data and storage technologies, building data pipelines, data warehousing, ETL tools, advanced concepts, best practices, and concluding with final projects and interview preparation. The plan provides learning resources like online courses, tutorials, and communities for each topic.

Uploaded by

Egodawatta Prasad
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
161 views

Data Engineering Study Plan

The document outlines a 20-week study plan to become a data engineer. It is divided into weekly topics that cover fundamental programming concepts, Python, databases, data manipulation with Pandas, big data and storage technologies, building data pipelines, data warehousing, ETL tools, advanced concepts, best practices, and concluding with final projects and interview preparation. The plan provides learning resources like online courses, tutorials, and communities for each topic.

Uploaded by

Egodawatta Prasad
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 4

#_ Becoming a Data Engineer [ the StudyPlan ]

🌐 Week 1-2: Introduction to Programming Concepts


● Explore fundamental programming concepts.
● Understand variables, data types, and basic operations.
● Get comfortable with control structures (if statements, loops).
● Additional Topics:
○ Introduction to Algorithms and Flowcharts.
○ Basics of Problem Solving.
● Resources:
○ Codecademy - Learn Python
○ Coursera - Programming for Everybody

🐍 Week 3-4: Dive Deeper into Python


● Work with more complex data structures: lists, dictionaries,
tuples.
● Learn about functions and their significance.
● Solve coding problems for practice.
● Additional Topics:
○ Object-Oriented Programming (OOP) Fundamentals.
○ Exception Handling and Debugging.
● Resources:
○ YouTube - Corey Schafer's Python Tutorials
○ edX - Introduction to Computer Science and Programming Using
Python

📊 Week 5-6: Introduction to Databases


● Grasp the basics of databases and their role in data engineering.
● Learn about relational databases, tables, and SQL queries.
● Practice querying and manipulating data.
● Additional Topics:
○ Normalization and Database Design.
○ Introduction to NoSQL databases.
○

By: Waleed Mousa


● Resources:
○ Khan Academy - Intro to SQL
○ YouTube - The Net Ninja's SQL Tutorial

🛠️ Week 7-8: Data Manipulation and ETL Processes


● Deep dive into data manipulation using Pandas.
● Understand the Extract, Transform, Load (ETL) process.
● Clean and transform real-world datasets.
● Additional Topics:
○ Data Visualization Basics.
○ Working with JSON and XML data.
● Resources:
○ DataCamp - Pandas Foundations
○ YouTube - Corey Schafer's Pandas Tutorial

💾 Week 9-10: Introduction to Big Data and Data Storage


● Learn about big data concepts and challenges.
● Explore distributed systems and data storage technologies.
● Introduction to Hadoop and HDFS.
● Additional Topics:
○ Data Privacy and Security.
○ Introduction to Cloud Computing.
● Resources:
○ Coursera - Big Data Basics
○ Big Data and Hadoop Full Course 2023 | Learn Big Data and…

⚙️ Week 11-12: Building Data Pipelines and Introduction to Spark


● Understand the importance of data pipelines.
● Introduction to Apache Spark and its capabilities.
● Build basic data pipelines.
● Additional Topics:
○ Data Streaming Concepts.
○ Introduction to Kafka for Data Streaming.

By: Waleed Mousa


● Resources:
○ Building Data Engineering Pipelines in Python Course |
DataCamp
○ Big Data Analysis with Scala and Spark | Coursera

🏢 Week 13-14: Data Warehousing and ETL Tools


● Understand the role of data warehousing in data engineering.
● Introduction to ETL tools like Apache NiFi or Talend.
● Create basic ETL processes.
● Additional Topics:
○ Dimensional Modeling for Data Warehousing.
○ Introduction to Data Governance.
● Resources:
○ Data Warehousing for Business Intelligence Specialization
○ Talend Full Course - Learn Talend in 6 Hours | Talend Tut…

📈 Week 15-16: Advanced Data Engineering Concepts


● Deepen your understanding of distributed computing.
● Learn about data lakes and data warehouses.
● Explore real-time data processing.
● Additional Topics:
○ Advanced Spark Concepts: Spark SQL, MLlib.
○ Data Engineering in the Cloud (AWS, Azure, GCP).
● Resources:
○ edX - Big Data Fundamentals
○ Database vs Data Warehouse vs Data Lake | What is the Dif…

🌟 Week 17-18: Data Engineering Best Practices and Projects


● Learn industry best practices for data engineering.
● Work on small data engineering projects.
● Collaborate with other learners or online communities.
● Additional Topics:
○ Data Quality and Data Cleaning Strategies.
○ Introduction to Data Catalogs and Metadata Management.

By: Waleed Mousa


● Resources:
○ Data Engineering Essentials using SQL, Python, and PySpark |
Udemy
○ GitHub - Awesome Data Engineering - Curated list of
resources.

🏁 Week 19-20: Final Projects and Interview Preparation


● Apply your knowledge by working on more complex data projects.
● Prepare for data engineering job interviews.
● Polish your resume and portfolio.
● Additional Topics:
○ Mock Interview Practice.
○ Common Data Engineering Interview Questions.
● Resources:
○ Kaggle Datasets - Real-world datasets for practice.
○ Interview Query - Practice data engineering interview
questions.

By: Waleed Mousa

You might also like