Azure Data Engineer

Azure Data Engineer

Experience: 5+ Years
Tech Skills: Azure Data Factory (ADF), Databricks, SQL, PySpark, Azure Synapse, Azure Blob Storage, Azure Data Lake, ETL, Data Modeling, Python

Experienced Azure Data Engineer with 5+ years of expertise in designing, implementing, and optimizing data pipelines and analytics solutions on the Azure cloud platform. Skilled in Azure Data Factory, Databricks, Synapse, and Data Lake, with hands-on experience in ETL, data transformation, and performance tuning. Strong ability to collaborate with stakeholders to deliver scalable, secure, and high-performance data solutions.

• Data Engineering & ETL: Design and development of scalable data pipelines using ADF, Databricks, Python, and SQL.

• Azure Cloud Platform: Expertise in Azure Data Factory, Data Lake, Blob Storage, Synapse Analytics, Databricks, and other Azure services.

• Data Modeling & Optimization: Design of star/snowflake schemas, performance tuning, and optimization of large datasets.

• Analytics & Reporting: Support for business analytics by creating structured and reliable data pipelines.

• Collaboration & Governance: Working with business teams to define data requirements, ensuring data quality, security, and governance.

1. Azure Data Pipelines & ETL – Designed end-to-end ETL pipelines using ADF and Databricks, integrating multiple source systems into Azure Data Lake for enterprise reporting.

2. Data Transformation & Analytics – Developed PySpark scripts in Databricks to process structured and unstructured data efficiently.

3. Data Integration & Automation – Automated workflows and scheduling using ADF triggers and monitored pipeline performance to ensure SLA compliance.

4. Cloud Optimization & Performance – Optimized large-scale datasets in Azure Synapse and Blob Storage, improving query performance by 30%.

5. Reporting & Insights – Supported Power BI dashboards and reporting by providing clean, structured, and timely data feeds.

• Cloud: Azure Data Factory, Azure Databricks, Azure Synapse, Azure Data Lake, Blob Storage

• Programming: Python, PySpark, SQL

• ETL & Pipeline Tools: Azure Data Factory, Databricks, Azure Functions

• Analytics & Reporting: Power BI, Azure Synapse

• Other Tools: Git, CI/CD pipelines, Jenkins, DevOps practices