This repository showcases data engineering projects designed to demonstrate practical skills in building data pipelines, orchestrating workflows, and managing cloud/on-premise data solutions.
Description:
An end-to-end ETL pipeline that extracts real-time flight information from the Aviationstack API, transforms the data using Python, and loads it into a PostgreSQL database.
Key Skills & Tools:
- Python (data extraction & transformation)
- PostgreSQL (data storage & querying)
- Apache Airflow (workflow orchestration and scheduling)
- Docker (containerized development environment)