Data Architect

Job Description

Genesis Consulting has an immediate opportunity for an experienced GCP Data Architect, with strong technical knowledge and a genuine passion for solving complex problems through technology. The professional will be part of a strategic project focused on reviewing and optimizing data architecture on Google Cloud Platform, seeking increased efficiency, scalability, governance, and significant reduction in BigQuery processing costs.

We are looking for a senior, consultative, and hands-on profile, capable of acting from the definition and review of the architecture to the implementation of the necessary improvements in the environment.

Technical Profile:

• Solid experience with Google Cloud Platform (GCP) and BigQuery, working in enterprise data environments with large volumes;
• Experience in architecture, optimization, and maintenance of cloud data platforms;
• Advanced knowledge of Data Lake architecture, including organization and optimization of Raw, Sub-Raw, Silver, Gold, and Platinum layers;
• Experience in designing incremental processing strategies, avoiding reprocessing and unnecessary reads of large data volumes;
• Advanced knowledge of BigQuery table optimization, including partitioning, clustering, incremental loads, and query optimization;
• Experience in analyzing BigQuery processing performance and costs;
• Knowledge of strategies for handling and processing large SAP tables;
• Experience with integration and data ingestion from environments like SAP and Salesforce;
• Knowledge of integration tools and technologies such as Airbyte, Apache Airflow, DAGs, and CDC – Change Data Capture;
• Ability to review data ingestion and processing pipelines, identifying opportunities for performance improvement and cost reduction;
• Knowledge of transactional and analytical data architecture, including appropriate definition of workloads for each type of processing;
• Ability to evaluate technological alternatives, including the use of databases like PostgreSQL for transactional workloads and frequent operational updates;
• Experience with FinOps practices applied to data and cloud, including analysis of consumption baselines, cost monitoring, and identification of optimization opportunities;
• Ability to structure mechanisms for tracking the savings achieved through implemented optimizations;
• Knowledge of cost allocation and visibility models by area, domain, project, or business unit;
• Experience with BigQuery environment governance, including project organization by domain or business area;
• Knowledge of IAM, permissions, access groups, and cross-project consumption strategies within GCP;
• Ability to critically analyze existing architectural decisions and propose technically sustainable and economically efficient alternatives;
• Practical experience in troubleshooting, production, and maintenance of critical data environments;
• Hands-on profile, with the ability to directly implement proposed solutions and optimizations.

Role:

• Act in reviewing the current data architecture in GCP and BigQuery, identifying opportunities for processing and consumption reduction;
• Establish a technical and financial baseline of the current environment for tracking the gains achieved;
• Work with an indicative reduction target between 50% and 60% of processing costs, conditional on opportunities identified during the technical analysis of the environment;
• Review architecture, modeling, pipelines, tables, queries, and processing strategies currently in use;
• Define and implement incremental processing strategies and optimization of the different Data Lake layers;
• Review transactional and analytical workloads, recommending the most suitable architecture for each scenario;
• Support the evolution of BigQuery governance, including project structure, domains, permissions, and cross-project consumption;
• Structure indicators for monitoring consumption, performance, and savings generated by optimization initiatives;
• Act in a consultative manner with technical teams, questioning architectural decisions and proposing solutions aligned with best practices in architecture, performance, and FinOps;
• Participate directly in the implementation, validation, production, and maintenance of proposed improvements;
• Act in a strategic project for optimization and evolution of the data platform in a large-scale enterprise environment.

Other

• English – Advanced (Differentiator)
• Google Cloud Certifications (Differentiator)