Data Engineer (Azure Data Factory)

Data Engineer (Azure Data Factory) Miejsce pracy: Wrocław Technologies we use Expected Python SQL Microsoft Azure Azure Data Factory ETL/ELT CI/CD Microsoft Power BI Optional dbt Operating system Windows macOS About the project As a Data Engineer, you will have the opportunity to support and further develop an Azure-based data integration solution built primarily around Azure Data Factory (ADF). The current environment includes Azure Functions and ingestion components, but daily delivery is still in its early stages. Your main tasks will be: - Designing and implementing ETL/ELT processes using Azure Data Factory (ADF) and other Microsoft tools; - Developing data pipelines to integrate with various data sources; - Ensuring the quality of data processing and ensuring that it meets business requirements; - Collaborating with stakeholders to identify and prioritize data integration needs; - Monitoring and troubleshooting data flows; - Maintaining and improving existing data integration solutions; - Participating in the development of new features and functionalities. Requirements: - Bachelor's degree in Computer Science, Information Technology or related field; - At least 2 years of experience in data engineering, preferably with Azure Data Factory (ADF) and other Microsoft tools; - Strong understanding of ETL/ELT processes and data integration concepts; - Experience with Python programming language and SQL databases; - Knowledge of Azure services such as Azure Functions, Azure Storage, and Azure Cosmos DB; - Familiarity with CI/CD pipelines and DevOps practices; - Understanding of data governance and compliance regulations (e.g., GDPR, HIPAA); - Excellent analytical and problem-solving skills; - Strong communication and collaboration skills. Benefits: - Opportunity to work on a cutting-edge Azure-based data integration solution; - Collaborative and dynamic work environment; - Professional development opportunities; - Flexible working hours and remote work options; - Access to the latest technologies and tools; - Competitive salary and benefits package.