Smals - Senior Data Engineer

As Senior Data Engineer, you will be part of the data team responsible for implementing the common data platform at a client who is a major player in social security for the domains unemployment, career break and time credit. You combine an analytical approach with technical expertise to design, build and maintain transformation pipelines. You are actively involved in the ingestion phase of the data lifecycle —from various sources such as databases, APIs, files and more. Your tasks include designing and implementing data pipelines using tools like Apache Beam, AWS Glue, Azure Data Factory or similar technologies. You will also be responsible for monitoring and maintaining these pipelines to ensure they run smoothly and efficiently. In addition, you will work closely with the data scientists to integrate their models into the pipelines and provide them with the necessary data. Your expertise in data engineering will help to improve the quality of the data and make it more accessible for analysis and decision-making. You are expected to have a strong understanding of data processing technologies such as Apache Spark, Hadoop, AWS Lake Formation or similar technologies. You should also be familiar with cloud-based data platforms like Amazon S3, Azure Blob Storage or Google Cloud Storage. Furthermore, you will work closely with the data architects to design and implement scalable and secure data architectures that meet the needs of our clients. Your tasks include designing and implementing data warehouses using tools like Amazon Redshift, Google BigQuery or similar technologies. You will also be responsible for monitoring and maintaining these data warehouses to ensure they run smoothly and efficiently. In addition, you will work closely with the data scientists to integrate their models into the data warehouses and provide them with the necessary data. Your expertise in data engineering will help to improve the quality of the data and make it more accessible for analysis and decision-making.