Data Engineer - Google Cloud Platform GCP

Data Engineer – Google Cloud Platform (GCP) Krakow - hybrid B2B cooperation We are looking for an experienced Data Engineer to join a large, international technology project in the financial sector. The project focuses on migrating on-premise solutions to Google Cloud Platform and building a modern, efficient data platform supporting credit decision-making processes. The system operates on a large scale and processes enormous amounts of data, which is why performance, scalability, reliability, and cost optimization of cloud solutions are essential elements of the role. Scope of Responsibilities Design and develop backend applications responsible for data processing in the Google Cloud Platform environment. Work with GCP storage solutions, particularly BigQuery, Cloud SQL, and Google Cloud Storage. Create and optimize Airflow DAGs / Cloud Composer. Utilize Google Cloud Dataflow for data processing. Develop cloud-native applications and deploy applications in the GKE / Kubernetes environment. Create processes and pipelines enabling data migration from on-premise infrastructure to GCP. Work with Cloud Storage, Pub/Sub, and other managed GCP services. Create reports in Looker according to business requirements. Optimize data processing in terms of performance and costs. Integrate backend solutions with other application components. Ensure security, authorization, and authentication. Build and develop CI/CD processes using, among others, Cloud Build, GitHub Actions, and Jenkins. Ensure high quality, security, and reliability of the developed solutions. Requirements Minimum 5 years of experience in Data Engineering / Cloud Engineering. Very good, practical knowledge of Google Cloud Platform (GCP). Experience with: BigQuery, Cloud SQL, Google Cloud Storage / GCP buckets, Airflow / Cloud Composer, Google Cloud Dataflow, GKE / Kubernetes. Experience in designing solutions using SQL and NoSQL databases, considering data volume, costs, retention, and backup. Knowledge of Cloud Build, Cloud Logging, and Cloud Monitoring. Experience in creating efficient and scalable data processing pipelines. Knowledge of Site Reliability Engineering (SRE) principles and building reliable systems. Knowledge of CI/CD and tools supporting code quality and security, e.g., Jenkins, SonarQube. Nice to have Experience with Looker. Knowledge of Pub/Sub. Experience in Analytics / Decisioning. Knowledge of Machine Learning solutions and Vertex AI / JupyterLab. Experience in the banking or financial sector, particularly in Credit Lending / Decisioning. Experience in end-to-end production environment support. Experience in performance tuning and building highly available and resilient systems. Project This is an opportunity to work on a major technological transformation involving the migration of systems to Google Cloud Platform and the development of a modern data platform. The project combines Data Engineering, cloud-native solutions, automation, and technologies used for large-scale data processing. What you gain by applying for the offer through Antal? If your application is positively considered (you will be invited to the process), you will receive support from a Consultant who will maintain regular contact with you (via email or phone), help you prepare for the interview with the future employer, and ensure the quality of the recruitment process you are currently participating in. Who are we? We are a leader in recruiting specialists and managers and in HR consulting. The brand is present in 35 countries, and has been operating in Poland since 1996. During this time, we have built many candidates' careers through a flexible and comprehensive approach to all recruitments. Antal is made up of over 130 professional recruitment consultants who are not only effective recruiters but also qualified advisors specializing in both their chosen sector and position.