Senior QA Engineer (Data Platforms)

We are seeking a Senior QA Engineer to ensure the stability, accuracy, and reliability of our Databricks-based data platforms. This role will primarily focus on validating and monitoring data pipelines, ETL processes, and backend data workflows within our Data Lake and Big Data environments. You will be responsible for implementing automated data quality checks, validating Databricks jobs regularly, and ensuring data integrity across the Data Market Hub platform. The position involves hands-on testing of data processing workflows, debugging of complex data issues, and collaboration with cross-functional teams to identify and resolve defects. Key responsibilities include: • Developing and maintaining automated test suites using Python-based frameworks such as Pytest or Behave; • Collaborating with Data Engineers to design and implement data pipelines and ETL processes; • Conducting thorough testing of data processing workflows, including data validation, data transformation, and data quality checks; • Troubleshooting complex data issues and collaborating with cross-functional teams to resolve defects; • Developing and maintaining documentation for automated test suites and data processing workflows; • Staying up-to-date with industry trends and emerging technologies in the field of big data and data engineering. Requirements: • Bachelor's degree in Computer Science, Information Technology, or a related field; • At least 5 years of experience in software testing, quality assurance, or a related field; • Strong understanding of data processing workflows, ETL processes, and data pipelines; • Experience with Databricks, Python, and big data technologies such as Hadoop, Spark, and Hive; • Familiarity with data validation, data transformation, and data quality checks; • Excellent analytical and problem-solving skills; • Strong communication and collaboration skills; • Ability to work in a fast-paced environment and prioritize tasks effectively. Benefits: • Competitive salary and benefits package; • Opportunities for professional growth and development; • Collaborative and dynamic work environment; • Flexible working hours and remote work options; • Access to cutting-edge technologies and tools; • Recognition and rewards for outstanding performance.