Senior Data Engineer - K/M @ ASTEK Polska

You have a minimum of 7 years of experience in Data Engineering and Python programming. You have practical experience in creating and developing APIs using FastAPI. You have excellent knowledge of Databricks, PySpark, SQL, and Delta Lake. You have experience with migrations to Unity Catalog. You have worked with Databricks Structured Streaming and real-time data processing solutions. You have experience working with Oracle and SQL Server databases and the Informatica tool. You can independently design and implement scalable data engineering solutions. You are familiar with the specifics of the Banking, Financial Services & Insurance (BFSI) sector.

Nice to have:

• Experience working with Azure cloud and Databricks administration.
• Knowledge of CI/CD tools and processes.
• Experience with Git, Azure DevOps, or GitLab.
• Ability to tune performance and optimize Spark solutions.
• Experience in leading technical activities and collaborating with stakeholders.
• Databricks certifications.

Hybrid work model: 3 days a week from the office in Krakow. Cooperation in a B2B model. We are looking for a person with a minimum of 7 years of experience, who independently designs and implements scalable Data Engineering solutions and supports initiatives related to data platform modernization. ,[Creating and developing services and integrations based on FastAPI., Building scalable ETL/ELT processes using Databricks and PySpark., Leading migrations to Unity Catalog and initiatives related to data platform modernization., Implementing and optimizing real-time data streaming processing solutions., Collaborating with business and technology teams in delivering enterprise-class solutions., Designing and implementing modern data engineering solutions that meet organizational needs.] Requirements: Python, SQL, Spark, FastAPI, Databricks, Azure, Azure DevOps Server, GitLab Additionally: Sport subscription, Private healthcare.