Senior Azure Data Engineer

SNI is serving as a trusted IT Outsourcing partner in line with the needs of World's most prestigious firms and carried out successful projects worldwide. Responsibilities: * Design and construct data structures, DDLs, tables, and views across MS Cloud SQL Server and Data Lake environments. * Develop Azure Databricks notebooks and PySpark/Spark SQL jobs to aggregate, join, and output standardized data formats (SFFs). * Configure automated Ingestion Frameworks to streamline data loading across staging and Data Lake Core (DLC) layers. * Build, optimize, and maintain large-scale batch and real-time data pipelines using Azure Data Factory and Databricks. * Monitor performance, tune complex SQL queries, and implement automation across data integration workflows. * Support data governance, tracking data consumption patterns, testing pipeline outputs, and promoting curated datasets to the data catalog. * Apply CI/CD practices and collaborate within cross-functional Agile/Scrum teams to deliver project estimates and technical solutions. Skills: * 5+ years of data engineering experience with a focus on enterprise ETL/ELT pipelines and cloud data platforms. * Mandatory certifications: Certified Azure Data Engineer and Databricks Certified Data Engineer. * Core Azure expertise: Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage (ADLS), and MS Cloud SQL Server. * Strong programming proficiency in Python, PySpark, Spark SQL, or Scala/Java. * Advanced SQL skills for data manipulation, query optimization, and relational database management. * Experience with legacy MS SQL stack technologies (SSIS, SSRS) and reporting tools (Power BI). * Experience with automated ingestion frameworks, big data processing, and CI/CD delivery practices in Agile environments. * Full professional fluency in both English and Polish. Follow us on Linkedin! http://linkedin.com/company/snisourcing/