Purushotham ML

Azure Data Engineer

Experienced Full-Stack Azure Data Engineer with 5+ years of expertise in Implementing,
Migrating, and Supporting large-scale big-data cloud projects across various data sources such as
CRM, Finance, and SCM. Proficient in addressing complex architectural and scalability
challenges, delivering actionable business insights, and ultimately boosting organizational
productivity and profitability.

[email protected] +91-7780310522

Bangalore, India linkedin.com/in/purushotham-ade

CORE COMPETENCIES
Big Data Engineering ETL/ELT

Cloud Computing Data Governance

Data Analysis and

Banking, Financial
Visualization
Services and Insurance
Customer (BFSI)
Relationship
Supply Chain
Management (CRM)
Management (SCM)

TECHNICAL SKILLS
Azure Data Factory - ADF Azure Databricks Azure Synapse Analytics Azure Storages - Blob & ADLS

Azure Key Vault Azure SQL Azure Devops Azure Event Hubs Azure CosmosDB Azure Functions

Data Lake Delta Lake Databricks SQL Power BI Hadoop Hive Spark Pyspark Python

Linux Shell Scripting Oracle SQL & PL/SQL MS SQL Server SSIS Apache Airflow Apache Kafka

Great Expectations IMMUTA REST API CI/CD Git & GitHub JIRA

EDUCATION
B-Tech
Jawaharlal Nehru Technological University
07/2010 - 0fl/2014, Hyderabad, India

CERTIFICATIONS
Microsoft Certified: DP-203 Azure Data Engineer
Associate (01/2023 - Present) Microsoft Certified: DP-900 Azure Data
Verify Certificate Credentials Fundamentals (12/2022 - Present)
Verify Certificate Credentials

Page 1 of 4
 WORK EXPERIENCE
Azure Data Engineer
Apex IT (PWC)
01/2024 - Present, Bangalore, India
Major Achievements:
Migrated ETL processes from SQL Server Integration Services (SSIS) to Azure Data Factory (ADF); There by enhancing
scalability & performance by 45%
Analyzed the existing SSIS package workflows and implemented them in Azure Data Factory (ADF) using
activities such as Lookup, Copy, Stored Procedure, and Switch activities.
Developed a Model Driven Architecture (MDA) as per ADF implementation guidelines, and created unit test
cases.
Additionally, designed and implemented stored procedures to support the development process.
Imported XLSX files into the application and ensured accurate file insertion using ADF pipelines.
Developed and configured Azure Functions to send email alerts for various data pipeline job statuses, improving monitoring
efficiency by 40% and reducing response time to issues by 30%.
Tools : Azure Data Factory, key vault, Azure functions, Linked services.

Azure Data Engineer

Glint Soft Infotech Pvt. Ltd. (Client: Wells Fargo)
01/2023 - 12/2023, Bangalore, India
Major Achievements:
Significant contributor in building SSOT (Single Source of Truth), one of the world's largest global data platforms. This
platform effortlessly onboards massive amounts of batch and real-time streaming data using modern cloud data services.
As a result, we achieved a 12x faster time-to-market, with use cases deployed in under 2 months. This
platform also led to a 28% increase in ROI for the bank's data products when compared to the siloed legacy
data systems.
Migrated on-premise Oracle and Microsoft ERP data warehouse infrastructures to Azure cloud and transformed the Oracle
PL/SQL and SSIS ETL data pipeline codebases to Pyspark on Databricks. This resulted in a 70% decrease in ETL/ELT
pipeline creation time and a significant improvement in data workload processing times, from 5.3 hours to
just 7 minutes, a 47x increase in efficiency.
Implemented a fine-grade data governance process with a blend of open-source and proprietary tools to mitigate
potential data quality and security issues on top of sensitive bank data in accordance with CCPA & GDPR regulatory
compliances. By eliminating the need for custom data validation and access control scripts, we saved
100's of hours and over $1.5 million in data engineering and machine learning operations costs.
Built a high-performing Lakehouse Platform by integrating Delta Lake framework with an existing Parquet-based Data
Lake, enabling Data Analysts and Data Scientists to access large-scale, high-quality data to build world-class analytical and
machine learning systems; Major performance gains after the Delta lake Adaption - Data Access, Data Hygiene
& Auditing activities improved by 78%. Also, saved 100's of hours by avoiding manual data optimization
techniques.
Tools : Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure DevOps, Immuta, Delta Lake, Pyspark, Databricks SQL, Oracle, MS SQL Server etc

Azure Data Engineer

SVS Management Services Pvt. Ltd.
04/2022 - 12/2022, Hyderabad, India
Major Achievements:
Developed and maintained end-to-end operations of ETL data pipelines and worked with large data sets in Azure Data Factory.
Researched and Implemented various components like pipeline, activity, mapping data flows, data sets, linked services,
triggers and control flow.
Conducted extensive troubleshooting to identify root causes of issues and implement effective resolutions in a timely manner.

Page 2
Tools : Azure Data Factory, key vault, Azure functions, Azure Synapse Analytics.

Page 3
 WORK EXPERIENCE
Data Engineer
CIEL HR Services Pvt. Ltd.
01/2021 - 02/2022, Hyderabad, India
Major Achievements:
Developed ADF data pipelines to move large batches of data from multiple on-premise data warehouses to Azure Storages.
As a result, there was a 45% improvement in ETL timings compared to the utilization of custom PL/SQL or
Python-based Airflow ETL processes.
Rewritten and migrated hundreds of HiveQL queries to Spark SQL, and MapReduce jobs to Pyspark Jobs resulting in
significant performance improvements. For instance, CIEL HR Sales dashboard results were 88% faster, taking
only 5 minutes instead of the previous 4.2 hours. Similarly, Sales forecasting results were improved by
83%, delivered in just 40 minutes instead of the previous 7 hours.
Developed custom analytical Spark SQL queries, and achieved better inventory management and cost reduction. This led to a
35% reduction in out-of-stock items and saved $4.5 million in inventory expenses annually.
Tools : Azure Data Factory, Pyspark, Spark SQL, Hadoop, MapReduce, Hive, Apache Airflow, Great Expectations, Oracle SQL, PLSQL etc.

SQL Associate
Harsha Vardhan Engineers Pvt. Ltd.
06/2019 - 12/2020, Hyderabad, India
Major Achievements:
Developed Oracle PL/SQL interface programs and set up automated data pipelines using Autosys job scheduler to streamline
the processing of terabytes of data from Mainframe flat files into Oracle Systems.
Rewritten and Refactored the legacy SQL codebase to optimize the data processing speeds, This resulted in a 30%
improvement in the data reporting process.
Developed various SQL queries and Linux shell scripts to cleanup unused data that had been sitting for years from CRM and
financial data sources, This has resulted in a significant freeing up of up to 15% of the database storage and
subsequent cost savings in the storage.
Tools : Oracle SQL, PL/SQL, Oracle ERP Business Suite, AutoSys, Linux Shell Scripting etc.

Page 4