Senior Data Engineer (f/m/x)

Senior Data Engineer (f/m/x) Place of work: Piła Technologies Required ETL Azure Data Apache Spark Data Valut Terraform SQL Python Scala Mile visible Java Scala About the project The project involves developing a modern cloud-based data platform, supporting analysis, reporting, and machine learning solutions. Data is processed in batch and real-time modes, with emphasis on scalability, automation, and high quality. The role gives a real impact on data architecture, designing pipelines, and ensuring data quality. Responsibilities include: • Designing and implementing data pipelines using ETL tools (Azure Data Factory, Apache Beam) and programming languages (Python, Scala); • Developing and maintaining large-scale data processing applications using Apache Spark; • Ensuring data quality by designing and implementing data validation rules and data cleansing processes; • Collaborating with cross-functional teams to integrate data pipelines with other systems and services; • Staying up-to-date with the latest trends and technologies in big data, machine learning, and cloud computing. What we offer: • Opportunity to work on a cutting-edge project that combines data engineering, machine learning, and cloud computing; • Collaborative and dynamic work environment; • Professional development opportunities; • Flexible working hours and remote work options; • Competitive salary and benefits package. Requirements: • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field; • At least 3 years of experience in data engineering, with a focus on cloud-based solutions; • Strong programming skills in Python, Scala, Java, or other languages; • Experience with ETL tools (Azure Data Factory, Apache Beam) and big data processing frameworks (Apache Spark); • Knowledge of data modeling, data warehousing, and business intelligence concepts; • Excellent problem-solving skills and attention to detail. What we're looking for: • A highly motivated and experienced data engineer who is passionate about working with large-scale datasets and cloud-based technologies; • Strong communication and collaboration skills; • Ability to work independently and as part of a team; • Willingness to learn and adapt to new technologies and processes.