Link Group
2 months ago
Senior Data Engineer
Sign up to save this job, get alerts, and apply with an optimized CV.
Company information
- Company
- Link Group
- Location
- Polska, mazowieckie, Warszawa Poland
- Posted
- 2 months ago
Job description
We are looking for a Data Engineer who will be responsible for designing and developing Data Platforms and scalable data solutions. This is a role combining advanced data engineering with real impact on platform architecture, technical standards, and its development direction. Scope of Responsibilities: * Designing and developing Data Platforms in a Lakehouse architecture. * Participating in architectural decisions regarding Data Platforms and data integration. * Designing and developing ELT processes for reporting, analytics, and AI/ML. * Creating data models and analytical layers. * Optimizing solutions for performance, cost, and scalability. * Defining Data Engineering standards, automation, and best practices. * Ensuring data quality, security, and compliance. * Collaborating with business, architects, and IT teams in solution design. * Acting as a technical leader in Data Platform initiatives. Requirements: * Minimum 3 years of experience in Data Engineering. * Experience in designing and maintaining production data pipelines. * Very good knowledge of: Python, PySpark, SQL, Terraform, YAML, Databricks Asset Bundles. * Experience with: Apache Spark, Databricks, Delta Lake, working with large data volumes. * Very good knowledge of Microsoft Azure services, in particular: Azure Data Factory, ADLS, Azure Databricks, Unity Catalog, Azure DevOps, Azure Event Hub. * Experience with Apache Airflow, CI/CD (Azure DevOps Repos & Pipelines), and Lakehouse and Medallion Architecture. * Knowledge of: Data Quality, Data Governance, data modeling, and access control in Unity Catalog. * Ability to translate business requirements into technical solutions. * Experience in code review, testing, deployment automation, and solution documentation. * Readiness to act as a technical leader and support the team in terms of standards and best practices. Nice to have: * Experience with Databricks LakeFusion, Microsoft Fabric (Data Engineering). * Knowledge of Databricks DQX or other data quality management tools. * Databricks or Data Engineering certifications.
Required skills
- databricks
- documentation
- ci/cd
- reporting
- sql
- data modeling
- python
- automation
- testing
- big data
- data engineer
- terraform
- azure devops
- microsoft azure
- data governance
- best practices
- delta lake
- ai/ml
- access control
- analytics
- data quality
- pyspark
- data integration
- scalability
- data models
- code review
- data platform
- apache airflow
- azure data factory
- data security
- data compliance
- adls
- data solutions
- microsoft fabric
- yaml
- technical leader
- elt
- deployment automation
- apache spark
- azure databricks
- azure devops pipelines
- azure event hub
- unity catalog
- medallion architecture
- lakehouse architecture
- analytical layers
- data engineering standards
- databricks asset bundles
- azure devops repos
- databricks lakefusion
- databricks dqx
Interested in this position?
Create your free account and tailor your CV to match this job.