EPAM Systems
1 month ago
Lead Data Quality Engineer
Sign up to save this job, get alerts, and apply with an optimized CV.
Company information
- Company
- EPAM Systems
- Location
- Kazakhstan
- Posted
- 1 month ago
Job description
We are looking for a skilled Lead Data Quality Engineer to support three key engineering streams (Data Product Engineering Framework, Polarmesh Portal, Platform Engineering Team). You will collaborate closely with Data Engineers, Platform Engineers, and DevOps teams to design, build, and maintain automated testing solutions across data pipelines, APIs, and platform components in a modern Azure-based ecosystem.
Responsibilities
- Design, build, and maintain automated testing solutions across data pipelines, APIs, and platform components
- Test data quality, data transformations, and pipeline outputs using SQL and/or Python
- Maintain and troubleshoot data pipelines to ensure reliability and performance
- Monitor, log, and diagnose pipeline failures to support timely resolution
- Collaborate with Data Engineers, Platform Engineers, and DevOps teams on testing strategies and solutions
- Implement CI/CD pipelines to support automated testing processes
- Apply automated testing approaches across data pipelines, APIs, and platform components
- Manage version control workflows to support collaborative development
Requirements
- 5+ years of experience as a QA Engineer / Test Automation Engineer in Data Engineering or Data Platform environments
- Proficiency in Azure cloud services
- Experience with Azure Databricks, Spark/PySpark, or similar big data platforms
- Understanding of data pipelines, ETL/ELT processes, and data pipeline maintenance
- Skills in SQL and/or Python for testing data quality, transformations, and pipeline outputs
- Experience with CI/CD pipelines, preferably using Azure DevOps, GitHub Actions, or similar tools
- Knowledge of automated testing approaches for data pipelines, APIs, and platform components
- Familiarity with version control systems such as GitHub
- Understanding of monitoring, logging, and troubleshooting pipeline failures
- Capability to work closely with Data Engineers, Platform Engineers, and DevOps teams
- English proficiency at B2 level or higher
Nice to have
- Experience with Delta Lake, Azure Data Factory, ADLS, Synapse, or Event Hub
- Knowledge of infrastructure as code tools such as Terraform or ARM/Bicep
- Experience with data quality tools/frameworks
- Understanding of Docker, Kubernetes, or containerized environments
- Experience in Agile/Scrum teams
Required skills
- docker
- automated testing
- ci/cd
- monitoring
- github
- sql
- etl
- python
- kubernetes
- scrum
- troubleshooting
- agile
- github actions
- big data
- spark
- azure
- apis
- devops
- terraform
- azure devops
- version control
- delta lake
- infrastructure as code
- pyspark
- data pipelines
- azure data factory
- adls
- logging
- english proficiency
- containerized environments
- elt
- data engineers
- azure databricks
- arm/bicep
- synapse
- event hub
- platform engineers
- data quality tools
- platform components
- data quality engineer
Interested in this position?
Create your free account and tailor your CV to match this job.