Sign up to save this job, get alerts, and apply with an optimized CV.

Log in Sign up free

Senior Data Engineer @ Link Group

Full Time 240000.00 - 324000.00

Job description

  • Minimum 3 years of experience in Data Engineering.
  • Experience in designing and maintaining production data pipelines.
  • Very good knowledge of: Python, PySpark, SQL, Terraform, YAML, Databricks Asset Bundles.
  • Experience with: Apache Spark, Databricks, Delta Lake, working with large data volumes.
  • Very good knowledge of Microsoft Azure services, in particular: Azure Data Factory, ADLS, Azure Databricks, Unity Catalog, Azure DevOps, Azure Event Hub.
  • Experience with Apache Airflow, CI/CD (Azure DevOps Repos & Pipelines), and Lakehouse architecture and Medallion Architecture.
  • Knowledge of: Data Quality, Data Governance, data modeling, and access control in Unity Catalog.
  • Ability to translate business requirements into technical solutions.
  • Experience in code review, testing, deployment automation, and solution documentation.
  • Readiness to act as a technical lead and support the team in terms of standards and best practices.
Nice to have
  • Experience with Databricks LakeFusion, Microsoft Fabric (Data Engineering).
  • Knowledge of Databricks DQX or other data quality management tools.
  • Databricks or Data Engineering certifications.
We are looking for a Data Engineer who will be responsible for designing and developing the Data Platform and scalable data solutions. This is a role that combines advanced data engineering with real impact on the platform architecture, technical standards, and its development direction. [Designing and developing the Data Platform in a Lakehouse architecture. Participating in architectural decisions regarding the Data Platform and data integration. Designing and developing ELT processes for reporting, analytics, and AI/ML. Creating data models and analytical layers. Optimizing solutions for performance, cost, and scalability. Defining Data Engineering standards, automation, and best practices. Ensuring data quality, security, and compliance. Collaborating with business, architects, and IT teams in solution design. Acting as a technical lead in Data Platform initiatives.] Requirements: Data engineering, Python, PySpark, SQL, Terraform, YAML, Databricks Asset Bundles, Apache Spark, Databricks, Delta Lake, Microsoft Azure, Azure Data Factory, ADLS, Azure Databricks, Unity Catalog, Azure DevOps, Azure Event Hub, Apache Airflow, CI/CD, Azure DevOps Repos and Pipelines, Lakehouse, Medallion Catalog, Code review, Testing, Automation, Databricks LakeFusion, Microsoft Fabric, Databricks DQX, Databricks certification, Data Engineering certificate

Required skills

databricks ci/cd sql data modeling python automation testing terraform azure devops microsoft azure data governance delta lake ai/ml data quality data engineering pyspark scalability code review apache airflow azure data factory adls technical lead azure pipelines microsoft fabric yaml elt deployment automation apache spark azure databricks azure event hub unity catalog medallion architecture lakehouse architecture databricks certification databricks asset bundles azure devops repos databricks lakefusion databricks dqx data engineering certification

Sign up to apply

Create a free account to apply for this job and get access to:

  • AI-powered CV optimization for this specific job
  • Save jobs and create custom alerts
  • See your CV match score for each job
Create free account Log in

Company information

Company
Link Group
Location
Polska
Poland
Posted
3 weeks ago
View all jobs at Link Group

Find similar jobs

Explore more opportunities like this one.

Jobs in Poland

Interested in this position?

Create your free account and tailor your CV to match this job.

Create free account Log in