Azure Data Engineer- Databricks,Python,SQL

Data Engineer
Candidate can work from any of the location: Toronto, London, Winnipeg (Hybrid - 3 days on site)



We are seeking a skilled and experienced Data Engineer to join our BFSI technology team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures using Microsoft Azure tools. This role plays a critical part in enabling data-driven decision-making across banking, financial services, and insurance operations, while ensuring compliance with industry regulations.
________________________________________
Key Responsibilities:
1. Design and implement scalable data pipelines using Azure Data Factory, Azure Synapse Analytics, and Azure Databricks.
2. Build and maintain data lakes and data warehouses to support analytics, reporting, and machine learning initiatives.
3. Integrate data from diverse BFSI sources including core banking systems, insurance platforms, CRM, and third-party APIs.
4. Ensure data quality, integrity, and security across all stages of the data lifecycle, adhering to BFSI compliance standards (e.g., OSFI, PCI-DSS).
5. Develop and optimize ETL/ELT processes for structured and unstructured data using Azure-native tools.
6. Collaborate with Data Analysts, Data Scientists, and Business Teams to understand data requirements and deliver reliable solutions.
7. Implement monitoring and logging mechanisms to ensure performance, reliability, and traceability of data workflows.
8. Automate data ingestion and transformation workflows to support real-time and batch processing needs.
9. Maintain documentation and metadata repositories to support data governance and lineage tracking.
10. Stay current with Azure innovations and BFSI data trends to continuously improve architecture and performance.
________________________________________
Qualifications:
• Bachelor’s degree in Computer Science, Engineering, or related field.
• 3+ years of experience in data engineering, preferably in BFSI or regulated industries.
• At least 5 years of working from Canada
• Strong hands-on experience with Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage, and Azure SQL.
• Proficiency in SQL, Python, Spark, and data modeling.
• Familiarity with data governance frameworks, security protocols, and regulatory compliance in BFSI.
• Experience with CI/CD pipelines, version control (e.g., Git), and DevOps practices is a plus.
• Excellent problem-solving and communication skills.