Data Engineering Specialist - Affirmative for people with disabilities

Have you ever thought about elevating the data and MLOps platform of the largest database in Latin America to the level of companies like Uber, Netflix, and Airbnb? If you're driven by innovation and enjoy working continuously with all areas of the company, come join our team!

You will be responsible for:

• Development of a data platform for consumption from various sources, batch, and real-time.
• Development of APIs for access and consumption of data (data products).
• Facilitating dissemination of knowledge on best practices for using data (data contracts, federated governance, and platform engineering).
• Ensuring that the architecture meets technical requirements and needs of the execution team, working together with IT teams (Architecture, Security, Infrastructure) and business areas.
• Autonomy and initiative to act in problem-solving.

What will your daily routine be like?

• Ensuring deliveries from the squad on projects agreed upon with client areas.
• Interacting with business units, third parties, suppliers, and/or service providers to ensure the best understanding and implementation of data and architecture.
• Participating in data-driven discussions within the team and between business areas, supporting important decisions.
• Making interface with technology and product teams to define best practices for storing and consuming data, as well as suggesting, testing, and following up on implementing new technologies.

Hard skills

• Spark (Batch & Streaming)
• Proficiency in programming languages (Python)
• Pipeline orchestration for data (Airflow);
• AWS Data Stack (DynamoDB, s3, Lambda, EMR, MSK, Glue, Athena, Lake Formation, RDS)
• Data lake/Lakehouse (iceberg/delta)
• Data architecture
• Best practices in software engineering
• Automated testing
• Knowledge of CI/CD

Soft Skills

• Willingness to learn
• Teamwork / Collaborative Profile;
• Having good communication and interpersonal relationships;