Azure Data Engineer

About the Role

We are hiring an exceptional Azure Data Engineer to strengthen our growing data engineering function in London. This role is ideal for a highly motivated engineer with solid experience in Azure data services who can design, build, and optimise complex data solutions that drive business insights.

You will work with large-scale datasets, modern cloud data platforms, and cutting-edge technologies to deliver high-impact data products. This is a fantastic opportunity for an engineer looking to step into a high-ownership, high-visibility position within a fast-scaling organisation.

What You’ll Do

Architect, design, and develop end-to-end Azure data pipelines using ADF, Databricks (PySpark), Azure Synapse, and ADLS Gen2.

Build robust ETL/ELT systems to power analytics, data products, and machine learning pipelines.

Implement scalable Data Lakehouse solutions following best practices (e.g., Delta Lake, medallion architecture).

Develop and optimise SQL queries, stored procedures, and analytical models for performance and reliability.

Collaborate with product, engineering, and analytics teams to translate business needs into technical solutions.

Establish standards for data quality, lineage, observability, and governance.

Automate processes using Azure DevOps CI/CD pipelines and Infrastructure-as-Code tools.

Drive continuous improvement across data architecture, cost optimisation, and cloud performance.

Troubleshoot production pipelines and provide operational excellence.

What You’ll Bring

2–4+ years of hands-on experience as a Data Engineer or Azure Cloud Data Engineer.

Solid expertise in Azure Data Factory, Azure Databricks/Spark, Synapse Analytics, and ADLS Gen2.

Strong proficiency in:

Python / PySpark

SQL and data modelling

Distributed data processing (Spark)

Experience with Delta Lake, Lakehouse architecture, or data warehouse/data lake solutions.

Good understanding of Azure DevOps, Git, CI/CD, and automated deployment pipelines.

Awareness of data governance, GDPR compliance, data security standards.

Excellent problem-solving skills and the ability to work in fast-paced Agile teams.⭐ Bonus Skills (Nice-to-Have)

Microsoft certification (DP-203 or AZ-900).

Experience with real-time data (Kafka, Event Hub).

Working knowledge of Power BI or other BI platforms.

Exposure to ML pipelines or MLOps frameworks.