Blue Pearl HQ
7 months ago
Azure Data Engineer
Sign up to save this job, get alerts, and apply with an optimized CV.
Company information
- Company
- Blue Pearl HQ
- Location
- South Africa, Gauteng, Johannesburg South Africa
- Posted
- 7 months ago
Job description
The Azure Data Engineer will be responsible for designing, building, optimizing, and maintaining data pipelines and data solutions within the Microsoft Azure ecosystem. The role requires strong experience in cloud-based data engineering, modern data architectures, and scalable data processing frameworks. Key Responsibilities Design, develop, and maintain Azure-based data pipelines (batch and streaming). Implement ETL/ELT solutions using Azure Data Factory (ADF), Azure Databricks, Synapse Analytics, and other Azure data services. Develop and maintain data models, data warehouses, and data lakes. Optimize data pipelines for performance, scalability, and cost-efficiency. Implement data governance and security best practices. Monitor and troubleshoot data pipelines and data solutions. Collaborate with other teams, including data scientists, data analysts, and software engineers. Stay up-to-date with the latest Azure data services and technologies. Required Skills & Experience Bachelor's degree in Computer Science, Information Systems, or a related field. Proven experience as a Data Engineer with a focus on Azure data services. Strong understanding of data warehousing concepts, ETL/ELT processes, and data modeling. Hands-on experience with Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage, and other Azure data services. Experience with data pipeline orchestration tools. Proficiency in SQL and other programming languages such as Python or Scala. Experience with data governance, data security, and compliance. Excellent problem-solving, communication, and collaboration skills. Familiarity with DevOps practices and CI/CD pipelines. Preferred Skills & Experience Azure certifications (e.g., Azure Data Engineer Associate). Experience with big data technologies such as Spark. Experience with streaming data technologies such as Azure Stream Analytics or Kafka. Experience with data visualization tools such as Power BI. Experience with NoSQL databases. Benefits Competitive salary and benefits package. Opportunities for professional development and certifications. Collaborative and innovative work environment. Flexible work arrangements. Opportunity to work on challenging and impactful projects. Remote work options.
Required skills
- kafka
- etl/elt
- ci/cd
- sql
- power bi
- python
- spark
- azure
- devops
- nosql
- data governance
- data models
- data architectures
- data pipelines
- scala
- data visualization
- data security
- data lakes
- data warehouses
- data solutions
- synapse analytics
- azure data engineer
- azure databricks
- azure stream analytics
- azure certifications
- cloud-based data engineering
- azure data factory (adf)
Interested in this position?
Create your free account and tailor your CV to match this job.