VP of Data Engineering - Sumitomo Mitsui Banking Corporation

Responsibilities • Define and execute comprehensive test strategies covering statistical, ML, LLM and agentic AI models. • Perform functional, regression and scenario-based testing of model behaviours and workflows. • Conduct AI/ML evaluations including accuracy checks, bias/fairness assessment, robustness analysis and drift detection. • Assess end-to-end model workflows including data inputs, feature transformations, task completion, tool-use accuracy and multi-step reasoning. • Design and implement comprehensive test plans for AI/ML models to ensure high-quality performance and reliability. • Collaborate with cross-functional teams to integrate AI/ML models into existing systems and processes. • Develop and maintain documentation of testing procedures, results, and recommendations. • Stay up-to-date with the latest advancements in AI/ML and apply knowledge to improve testing strategies and methodologies. • Provide expert-level guidance on AI/ML testing best practices and standards to team members.