Mid Level Cloud DataOps Engineer (31875)

Descrição da vaga In the position of Mid Level Cloud DataOps Engineer, you will be part of a cross-functional agile team, with the mission of developing, deploying, and maintaining scalable and cloud-native solutions using cutting-edge DevOps practices. Main responsibilities: Build and maintain scalable data ingestion, transformation, and publication pipelines using Databricks on Azure. Use Apache Airflow deployed in kubernetes to orchestrate Databricks workflows efficiently. Implement and operate data quality controls, monitoring, and logging mechanisms. Collaborate with Data Engineers to design and implement data pipelines that meet business requirements. Develop and maintain automated testing frameworks for data pipelines. Participate in code reviews and ensure adherence to coding standards. Stay up-to-date with the latest cloud-native technologies and best practices. Implement and operate data governance policies and procedures. Ensure compliance with security, privacy, and regulatory requirements. Collaborate with Data Scientists to design and implement data pipelines that meet business requirements. Develop and maintain automated testing frameworks for data pipelines. Participate in code reviews and ensure adherence to coding standards. Stay up-to-date with the latest cloud-native technologies and best practices. Implement and operate data governance policies and procedures. Ensure compliance with security, privacy, and regulatory requirements.