Senior Data Engineer (Databricks Expert) @ DCG Sp. z o.o

Minimum 5 years of experience in designing and building Business Intelligence, ETL/ELT, Data Warehouse, Data Lake, Data Lakehouse, Big Data and OLAP-class solutions, with Databricks used as the core platform in production environments Practical knowledge of various relational and non-relational database engines, applied in the context of building and operating Databricks-based data platforms Strong proficiency in SQL and Python (minimum 5 years of experience) Familiarity with data engineering and its applications in big data analytics, machine learning, and business intelligence, including data processing, data integration, data quality, data governance, and data visualization Experience in designing and implementing scalable, secure, and reliable data pipelines, using Databricks as the primary platform for data engineering tasks Knowledge of cloud-based data platforms, such as AWS, Azure, Google Cloud Platform, and Snowflake, with experience in deploying and managing large-scale data processing workloads on these platforms Familiarity with containerization technologies, such as Docker, and orchestration tools, like Kubernetes, to manage complex data workflows and ensure high availability and scalability of data pipelines Strong understanding of data security and compliance requirements, including GDPR, HIPAA, and PCI-DSS, and experience in implementing data encryption, access controls, and auditing mechanisms to ensure the confidentiality, integrity, and availability of sensitive data Experience in working with distributed computing frameworks, such as Apache Spark, Hadoop, and Presto, and knowledge of their applications in big data analytics and machine learning Familiarity with data visualization tools, such as Tableau, Power BI, and QlikView, and experience in creating interactive dashboards and reports to support business decision-making