Senior Data Engineer

Job Description: We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging. You will have the opportunity to use your expertise in solving big data problems and apply design thinking, coding and analytical skills to develop data pipelines that support marketing data products. We’re looking for talented Data Engineers passionate about building new data-driven solutions and collaborating with cross-functional teams. Responsibilities: * Design, build, and maintain scalable and reliable data pipelines using a variety of technologies. * Implement and optimize ETL processes for ingesting, transforming, and loading large datasets. * Develop and maintain data infrastructure, including data lakes, data warehouses, and data marts. * Collaborate with data scientists, analysts, and other engineers to understand data requirements and deliver data solutions. * Monitor and troubleshoot data pipelines and infrastructure, ensuring data quality and availability. * Stay up-to-date with the latest data engineering trends and technologies. * Participate in code reviews and contribute to the team's knowledge sharing. * Work closely with the Data Science and Analytics teams to provide data support for their initiatives. Qualifications: * Bachelor's or Master's degree in Computer Science, Engineering, or a related field. * 5+ years of experience in data engineering or a related role. * Strong programming skills in Python or Scala. * Experience with big data technologies such as Hadoop, Spark, and Hive. * Experience with cloud platforms such as AWS, Azure, or GCP. * Experience with data warehousing solutions such as Snowflake, Redshift, or BigQuery. * Experience with ETL tools such as Apache Airflow, Luigi, or similar. * Strong understanding of data modeling, data warehousing, and data governance principles. * Excellent communication and collaboration skills. Bonus Points: * Experience with real-time streaming technologies such as Kafka or Kinesis. * Experience with data cataloging tools such as Alation or Collibra. * Experience with containerization and orchestration technologies such as Docker and Kubernetes. * Experience with CI/CD pipelines for data engineering projects. Benefits: * Competitive salary and benefits package. * Opportunity to work on challenging and impactful projects. * Collaborative and supportive work environment. * Professional development and growth opportunities. * Flexible work arrangements.