emagine Polska
3 weeks ago
Data Engineer
Sign up to save this job, get alerts, and apply with an optimized CV.
Company information
- Company
- emagine Polska
- Location
- Polska, mazowieckie, Warszawa Poland
- Posted
- 3 weeks ago
Job description
Industry: banking Rate: up to PLN 175/h net + VAT, B2B Location: Warsaw (2 times a week from the office) Long-term project What you will be doing: Implementing data models prepared by architects and modelers Creating ETL/ELT processes in batch and streaming modes Developing models, transformations, and tests in dbt Core and PySpark Building and maintaining DAGs in Airflow / Cloud Composer Implementing data validation and quality control mechanisms Co-creating data seeding generators and frameworks Preparing unit, integration, and quality tests Maintaining technical documentation Supporting deployments to TEST, PREPROD, and PROD environments What we expect: 3+ years of experience as a Data Engineer or GCP Developer Very good knowledge of Python, PySpark, and SQL Practical experience with BigQuery and dbt Core Experience with Cloud Composer / Airflow, Cloud Storage, and Pub/Sub Experience in building ETL/ELT processes and processing large datasets Knowledge of GitHub, CI/CD, and good software development practices Experience in preparing unit, integration, or quality tests English at a level that allows working with technical documentation Nice to have: Knowledge of Dataproc or Dataflow Experience in streaming processes Knowledge of Terraform and Infrastructure as Code Experience in the area of Data Quality and Data Governance Knowledge of the financial or banking industry
Required skills
- ci/cd
- finance
- github
- sql
- etl
- python
- unit testing
- data engineer
- airflow
- terraform
- data governance
- infrastructure as code
- data quality
- pyspark
- banking
- cloud storage
- bigquery
- integration testing
- cloud composer
- pub/sub
- dataflow
- dataproc
- elt
- batch processing
- quality testing
- dbt core
- streaming processing
- gcp developer
Interested in this position?
Create your free account and tailor your CV to match this job.