Scribd
Upload
8 views

Deepanshu Sethi Azure Data Engineer

Uploaded by

ishan13dwivedi
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
8 views

Deepanshu Sethi Azure Data Engineer

Uploaded by

ishan13dwivedi
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 2

ISHAN DWIVEDI

[email protected]| 9917845862 | https://www.linkedin.com/in//ishan dwivedi-6723b1154/

I'm extremely passionate about my career as a Cloud Computing Engineer who loves finding patterns. I have strong
technical skills, particularly in ITSM (Incident, Problem, Change, Request Management), ITIL, DBMS|SQL, AWS (EC2, S3,
VPC), No code App Development, Python (Django, RESTful API, NumPy, pandas) and an academic background in
mathematics, engineering, statistics. I am Learning the implementation of tools like ServiceNow, BMC remedy and JIRA

EXPERIENCE
Core team Member- Cloud Computing | GDSC | Aug 2022 – July 2023
● Python Development
● Cloud Computing.
● Data Collection.
● Team Management.

TECHNICAL SKILLS
Languages: Python, SQL.
Relational Database: MySQL, PostgreSQL.
Frameworks: Django, FastAPI, TensorFlow.
Cloud Services: Microsoft Azure, AWS (EC2, S3, VPC), OCI.
Version Control: GitHub
Other Skills: ServiceNow (ITSM, CSM, flow design, ATF), JIRA, DBMS, Apache Hadoop, Docker, Data Structure
and Algorithm, Object Oriented Programming
PROJECTS
Capstone Project on Cloud 07/2023 - 09/2023

● Implemented a data ingestion framework to ingest a 70% raw parquet dataset from a 3rd-party
service into Azure Blob Storage.
● Revamped an interactive Databricks cluster, removing 40% of mismatched data types and incorrect
date formats from the dataset.
● Generated an Azure Storage Event Trigger in Azure Data Factory to execute the pipeline
automatically.
● Designed a Databricks job cluster, achieving 80% consistency in pipeline automation.
● Ingested an additional dataset from Amazon S3 to Azure Blob Storage with 100% consistency.
● Optimized the main dataset by 50%, adding 4 required columns.
● Saved the 100% processed Parquet dataset in Azure Data Lake Gen 2.

EDUCATION
B.Tech Kolkata
Dr Sudhir Chandra Sur Degree Engineering College (CGPA : 8.65) 08/2018 - 08/2022
CERTIFICATIONS
Ultimate Big Data Engineer Bangalore
Trendytech Inc 06/2023 -
Present

Currently enrolled in a Big Data Engineering course at Trendytech Inc, Bangalore, gaining knowledge in
processing petabytes of data using Spark and Databricks. Proficient in ingesting data from various sources
through Azure Data Factory, developing a strong understanding of Parquet and ORC. Completed industrial
projects involving Spark and cloud technologies.

You might also like