Login Enter

emagine Polska

3 weeks ago

Data Engineer

Sign up free Log in

Sign up to save this job, get alerts, and apply with an optimized CV.

Company information

Company
emagine Polska
Location
Polska, mazowieckie, Warszawa Poland
Posted
3 weeks ago
View all jobs at emagine Polska

Job description

Industry: banking Rate: up to PLN 175/h net + VAT, B2B Location: Warsaw (2 times a week from the office) Long-term project What you will be doing: Implementing data models prepared by architects and modelers Creating ETL/ELT processes in batch and streaming modes Developing models, transformations, and tests in dbt Core and PySpark Building and maintaining DAGs in Airflow / Cloud Composer Implementing data validation and quality control mechanisms Co-creating data seeding generators and frameworks Preparing unit, integration, and quality tests Maintaining technical documentation Supporting deployments to TEST, PREPROD, and PROD environments What we expect: 3+ years of experience as a Data Engineer or GCP Developer Very good knowledge of Python, PySpark, and SQL Practical experience with BigQuery and dbt Core Experience with Cloud Composer / Airflow, Cloud Storage, and Pub/Sub Experience in building ETL/ELT processes and processing large datasets Knowledge of GitHub, CI/CD, and good software development practices Experience in preparing unit, integration, or quality tests English at a level that allows working with technical documentation Nice to have: Knowledge of Dataproc or Dataflow Experience in streaming processes Knowledge of Terraform and Infrastructure as Code Experience in the area of Data Quality and Data Governance Knowledge of the financial or banking industry

Required skills

Interested in this position?

Create your free account and tailor your CV to match this job.