Octopus Energy Group
1 month ago
Data Engineer Mid-Level (m/f/d)
Sign up to save this job, get alerts, and apply with an optimized CV.
Company information
- Company
- Octopus Energy Group
- Location
- Berlin (DE) Germany
- Posted
- 1 month ago
Job description
Your Tasks:
Lakehouse & Data Engineering (approx. 50%):
-
Conception, setup, and tuning of performant pipelines based on Databricks.
-
Data modeling with dbt and orchestration of robust DAGs via Apache Airflow.
-
Governance & Performance:
-
Establishment of automated data quality checks, data lineage, and cluster optimization.
-
Analytics & Data Apps (approx. 25%):
-
Building a semantic metrics layer and self-service BI in Lightdash.
-
Development of interactive analysis tools and data apps in Python (Streamlit).
-
Data Science & ML (approx. 25%):
-
Exploratory analyses, prototyping, and training of ML models (e.g., forecasts, anomalies).
-
MLOps & Business Integration:
-
Experiment tracking on Databricks and delivery of results to business units.
-
-
-
-
Your Profile:
Professional Experience:
-
At least 2–4 years of practical experience in Data Engineering, Analytics Engineering, or a comparable role.
-
Core Engineering Stack:
-
Solid practical experience with Databricks (Delta Lake, Unity Catalog), dbt, and Apache Airflow.
-
BI & Data Apps:
-
Experience with Lightdash (or interest in code-based BI) and with Streamlit.
-
Code & Database Languages:
-
Excellent SQL (performance tuning, complex joins) and very good Python (pandas, PySpark, scikit-learn).
-
Methodology & Best Practices:
-
Proficient use of Git / CI/CD and modern modeling concepts (Star Schema).
-
Mindset & Languages:
-
Pragmatic hands-on mentality, strong communication skills, and very good German & English.
-
-
-
-
-
- Sustainable travel with our e-car leasing
Find Jobs in Germany on Arbeitnow
Required skills
- databricks
- ci/cd
- reporting
- sql
- python
- git
- data engineer
- dbt
- machine learning
- data science
- delta lake
- analytics
- energy infrastructure
- data quality
- data engineering
- pyspark
- apache airflow
- mid-level
- mlops
- pandas
- streamlit
- scikit-learn
- data lakehouse
- data lineage
- unity catalog
- star schema
- cluster optimization
- self-service bi
- analytics engineering
- lightdash
- intelligent metering systems
- wallbox
- smart meter gateway
- cls management
Interested in this position?
Create your free account and tailor your CV to match this job.