Data Engineer (Nearshore - German speaking) (m/f/d)

Title: Data Engineer (Nearshore - German speaking) (m/f/d) Description: Develop & Maintain Data Pipelines: Design, build, and maintain robust data pipelines (using SQL and DBT) to process and transform large volumes of data Implement Requirements in Pipelines: Incorporate new business logic and regulatory requirements into the data pipeline workflows, ensuring compliance and correct calculations Data Quality & Monitoring: Establish and enhance data quality checks, including implementing monitoring and alerting mechanisms to ensure pipeline outputs are accurate and reliable Testing & Quality Assurance: Create and maintain comprehensive unit, integration, and regression tests for data pipelines to guarantee stability and facilitate safe changes Data Modeling: Perform technical data modeling and design data models structures (ETL) processes resulting from Data Warehouse / Snowflake to support efficient data storage and retrieval Pipeline Orchestration & Observability: Manage pipeline orchestration (e.g., using Apache Airflow) and ensure technical observability and data lineage tracking across the pipeline infrastructure Performance & Reliability: Proactively optimize the performance of pipelines and ensure their robustness and reliability in production, including troubleshooting and resolving any technical issues SQL & Performance Tuning: Advanced SQL skills with hands-on experience in optimizing query performance on large datasets DBT (Data Build Tool): Strong expertise in DBT, including writing tests, creating macros, and using version control for data transformations Python Programming: Proficiency in Python for implementing complex data transformations, logic, and scripting tasks within the data pipeline Data Warehousing & ETL: Solid knowledge of data warehousing concepts and ETL processes, experience with Snowflake or similar modern data platforms is highly desirable Pipeline Tools: Familiarity with data pipeline orchestration and monitoring tools (e.g. Airflow, data observability frameworks) and best practices for maintaining data pipeline health Remote work possible IT is and always has been our core business that laid the foundation for Hays' success. We are the biggest privately owned IT recruitment agency in Germany and offer the best jobs for every career level – whether you are interested in vacancies in agile SMEs or international DAX groups. We are the biggest privately owned IT recruitment agency in Germany and offer the best jobs for every career level – whether you are interested in vacancies in agile SMEs or international DAX groups. Hays masters the entire IT job spectrum, from support to software architecture or digitalisation – thanks to our broad portfolio, we have something for everyone. In the last decades, we were able to support numerous IT experts with choosing the right path for a successful career, positioning ourselves as their lifelong partner. Our highly specialised consultants can cater to your every wish and expectation and will prepare you for interviews and contract negotiations. Give it a try and learn what the market has to offer – our services are free of charge, non-binding and discreet! We look forward to hearing from you.

Responsibilities

Develop & Maintain Data Pipelines: Design, build, and maintain robust data pipelines (using SQL and DBT) to process and transform large volumes of data Implement Requirements in Pipelines: Incorporate new business logic and regulatory requirements into the data pipeline workflows, ensuring compliance and correct calculations Data Quality & Monitoring: Establish and enhance data quality checks, including implementing monitoring and alerting mechanisms to ensure pipeline outputs are accurate and reliable Testing & Quality Assurance: Create and maintain comprehensive unit, integration, and regression tests for data pipelines to guarantee stability and facilitate safe changes Data Modeling: Perform technical data modeling and design data models structures (ETL) processes resulting from Data Warehouse / Snowflake to support efficient data storage and retrieval Pipeline Orchestration & Observability: Manage pipeline orchestration (e.g., using Apache Airflow) and ensure technical observability and data lineage tracking across the pipeline infrastructure Performance & Reliability: Proactively optimize the performance of pipelines and ensure their robustness and reliability in production, including troubleshooting and resolving any technical issues

Benefits

Remote work possible