Expert Data Engineer

About the Role:

The Data Engineer will work on enterprise-wide data provisioning, spanning multiple data governance domains and data assets. Responsibilities include ensuring secure data sharing, adhering to protection and compliance requirements, supporting enterprise Data & Analytics initiatives (including high-priority use cases), and enabling data provisioning for operational processes.

Role Responsibilities:

Data Engineers in this environment are custodians of critical data assets and pipelines. Responsibilities include:

· Building and maintaining large-scale Big Data pipelines on cloud-based data platforms

· Ensuring secure and compliant data sharing aligned with information classification standards

· Supporting enterprise Data & Analytics initiatives and high-priority use cases

· Continuously improving and automating data engineering processes

· Evaluating emerging tools and technologies to drive innovation

· Mentoring and upskilling team members

· Maintaining high-quality technical documentation

Requirements

About Essential Skills:

Candidates must demonstrate strong, above-average expertise in:

Cloud & Infrastructure

• Terraform
• Docker
• Linux / Unix
• CloudFormation
• CodeBuild / CodePipeline
• CloudWatch
• SNS
• S3
• Kinesis Streams (Kinesis, Firehose)
• Lambda
• DynamoDB
• Step Functions
• Parameter Store
• Secrets Manager

About Programming & Data Engineering:

• Python 3.x
• SQL (Oracle / PostgreSQL)
• PySpark
• Boto3
• ETL development
• Big Data platforms
• PowerShell / Bash

About Data Platforms & Tools:

• Glue
• Athena
• Technical data modelling & schema design (hands-on, not drag-and-drop)
• Kafka
• AWS EMR
• Redshift

About Business & Analytics:

• Business Intelligence (BI) experience
• Strong data governance and security understanding

About Advantageous Skills:

• Advanced data modelling expertise, especially in Oracle SQL
• Strong analytical skills for large, complex datasets
• Experience with testing, data validation, and transformation accuracy
• Excellent documentation, written, and verbal communication skills
• Ability to work independently, multitask, and collaborate within teams
• Experience building data pipelines using AWS Glue, Data Pipeline, or similar
• Familiarity with AWS S3, RDS, and DynamoDB
• Solid understanding of software design patterns
• Experience preparing technical specifications, designing, coding, testing, and debugging solutions
• Strong organisational abilities
• Knowledge of Parquet, AVRO, JSON, XML, CSV
• Experience with Data Quality tools such as Great Expectations
• Experience working with REST APIs
• Basic networking knowledge and troubleshooting skills
• Understanding of Agile methodologies
• Experience with documentation tools such as Confluence and JIRA

About Qualifications & Experience:

• Relevant IT, Business, or Engineering Degree
• Experience developing technical documentation and artefacts
• Experience with enterprise collaboration tools

About Preferred Certifications:

Candidates with one or more of the following will be prioritised:

· AWS Cloud Practitioner

· AWS SysOps Associate

· AWS Developer Associate

· AWS Architect Associate

· AWS Architect Professional

· HashiCorp Terraform Associate