Evaluation Scenario Writer - QA

At Mindrift , innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. The Mindrift platform, launched and powered by Toloka , connects domain experts with cutting-edge AI projects from innovative tech clients. Our mission is to unlock the potential of GenAI by tapping into real-world expertise from across the globe. Who we're looking for: We’re looking for curious and intellectually proactive contributors who never miss a chance to learn and grow. What you'll do: As an Evaluation Scenario Writer - QA, you will be responsible for creating high-quality evaluation scenarios that test AI models’ ability to understand and respond to real-world data. You will work closely with our team of experts to design and develop these scenarios, ensuring they are comprehensive, accurate, and relevant to the specific AI project being evaluated. What we're looking for: We’re looking for individuals who possess a strong understanding of AI, machine learning, and natural language processing concepts. You should have experience working with AI models, data annotation tools, and evaluation metrics. Additionally, you should be able to work independently and collaboratively as part of a distributed team. Requirements: Bachelor’s degree in Computer Science, Linguistics, or related field; 2+ years of experience in AI-related fields such as machine learning, natural language processing, or computer vision; Strong understanding of AI concepts, including supervised and unsupervised learning, neural networks, and deep learning; Experience working with AI models, data annotation tools, and evaluation metrics; Ability to work independently and collaboratively as part of a distributed team; Excellent communication and problem-solving skills. Benefits: Competitive salary; Comprehensive benefits package; Opportunities for professional growth and development; Collaborative and dynamic work environment.