Full Data Engineer

We are a software engineering consultancy with over 15 years of experience in software quality and high technical level when it comes to test automation, digital security, and DevOps culture.

_never stop studying and learning_, as we are always seeking excellence and development.

_value our collaborative environment_, as we believe in the strength of our team.

_act with transparency and respect_, as we seek to maintain ethical and moral standards in our relationships with colleagues, partners, and clients.

Our team is growing. We form a committed team focused on results and capable of solving challenging problems. Come transform the world of technology with us!

_As a Senior Data Engineer at PrimeUp you:_

• Will work within one of the largest banks in the country whose central purpose is to seek maximum innovation, sustainability, and good experiences for its collaborators and clients;
• You will have as main challenges:
• Develop pipelines for data ingestion from original systems to Data Lake (raw/trusted);
• Create pipelines for transformation to meet business needs;
• Implement pipelines in batch and streaming (NRT);
• Automate pipelines for execution according to business requirements;
• Create controls for re-execution/retake in case of error;
• Define and implement data architecture for scalable and resilient solutions;
• Lead development and maintenance of complex pipelines (ETL/ELT) in Databricks and GCP;
• Model data for Data Lake and Data Warehouse, ensuring quality and governance;
• Orchestrate processes with Airflow/Composer or equivalents;
• Document architecture and standards, promoting good practices of CI/CD and versioning;
• SUPPORT multidisciplinary squads, translating technical and business requirements into robust solutions;
• Participate in agile ceremonies and support internal processes (ex.: GMUD);
• Design and implement systems based on GenAIOps, with CI/CD practices and model monitoring;
• Work with AI generative tools: Vertex AI, AgentSpace, AgentEngine, LangChain, CrewAI;
• Apply modern protocols and frameworks: A2A vs MCP, RAG, Responsible AI, LLMs.

_To succeed in this challenge, it is important that you have experience/knowledge in:_

• Transactional databases (Oracle, Sybase, SQL Server, MySQL);
• Analytical databases (BigQuery);
• DBT and data/system integration;
• GCP Dataflow (Apache Beam), Composer (Airflow) and Google Cloud Storage;
• GCP products: GKE, Cloud Run, Cloud Functions, Vertex AI;
• CI/CD (GitHub, Jenkins or similar);
• Distributed architectures, REST APIs, and microservices;
• Ageless environments (Scrum/Kanban).

_It would be great if you also had:_

• Background in system development in Java/Python;
• Experience with modern IA Generative architectures;
• Familiarity with MLOps (monitoring, retraining, tracking models);
• Experience with framework versioning and experiment tracking (MLflow or similar);
• GCP certification (Professional Machine Learning Engineer or Data Engineer).

_Obs.: The vacancy is remote for candidates outside the metropolitan regions of RJ and SP. For residents in the metropolitan regions of RJ and SP, the model is hybrid (1 time per week on-site)._

_As part of the PrimeUp team you will have the right to:_

• CLT employment contract with compatible market remuneration;
• Vale Alimentação;
• Vale Refeição;
• Health Plan;
• Dental Plan;
• LIFE Insurance;
• Annual Leave Bonus;
• Certification Reimbursement;
• PrimeUp Academy (professional training network);
• Participation in Profits and Results (PLR);
• Academy Plan;
• Well-being Program with psychological, social, financial, and legal support.

Powered by JazzHR