Data Engineer III Analyst

Main Activities:

• Design and implement complex data architectures (Data Lake, Lakehouse) using AWS services such as Step Functions, Lambda, Glue, DMS, Redshift, EMR, Athena, Kinesis, and DynamoDB;
• Lead the construction and optimization of scalable data pipelines, applying best practices for performance and security;
• Serve as a reference in performance tuning with Spark, Redshift, and DMS;
• Implement real-time data processing pipelines using Kinesis and Kafka;
• Lead technical meetings with clients, presenting solutions, validating requirements, and generating positive impact;
• Transform solutions into reusable frameworks for efficiency and scalability gains;
• Support the development of advanced dashboards with QuickSight;
• Work on security and compliance projects, ensuring conformity with LGPD, GDPR, and best practices;
• Collaborate with data scientists, developers, and business stakeholders, translating technical requirements into effective solutions;
• Mentor junior and senior data engineers, disseminating knowledge and best practices;
• Lead end-to-end data engineering projects: planning, execution, and delivery;
• Contribute to the creation of technical documentation, playbooks, and engineering standards;
• Participate actively as a speaker in technical meetings and events.

Requirements:

• Bachelor's degree in fields such as Technology, Computing, Engineering, or similar;
• Experience with Hadoop, Hive, Presto, Iceberg, and Airflow;
• Practical experience in DevOps: CloudFormation, Terraform, and pipelines in Bitbucket;
• Expertise in AWS services for Glue, Redshift, DMS, EMR, Athena, DynamoDB, Kinesis;
  
• Advanced knowledge of Python, SQL, Spark, and familiarity with Java or Scala;
• Advanced knowledge of data engineering and Medallion;
• Advanced knowledge of cloud security and best practices for LGPD and GDPR;
• Ability to communicate clearly and strategically with different audiences, including high-level management and stakeholders;
• Advanced knowledge of data governance and optimized costs in AWS;
• Intermediate to advanced English;
• AWS Professional or Specialty certification (desirable).

Addtional Information:

Hybrid work arrangement in the Barueri/SP region.