Machine Learning Researchers

Role Overview Mercor is partnering with a leading AI research lab on Project Vesuvius , an initiative designed to evaluate and enhance the ability of large language models (LLMs) to generate structured, high-quality research plans for open-ended machine learning problems. We are seeking Machine Learning Researchers and PhDs to serve as annotators who will assess and provide structured feedback on AI-generated research plans. The goal is to improve how LLMs function as brainstorming partners for open-ended research problems. Responsibilities * Evaluate AI-generated research plans. * Provide structured feedback on research plan quality, including areas such as: * Novelty * Clarity * Completeness * Feasibility * Collaborate with the research team to refine annotation guidelines and processes. * Participate in calibration exercises to ensure consistency in annotation. * Meet annotation deadlines and maintain a high level of accuracy. Qualifications * PhD in Machine Learning, Computer Science, or a related field, or equivalent experience. * Strong understanding of machine learning research methodologies. * Familiarity with various machine learning concepts and techniques. * Excellent written and verbal communication skills. * Strong attention to detail and ability to provide constructive feedback. * Experience with research plan generation or evaluation is a plus. Benefits * Competitive pay * Opportunity to work on cutting-edge AI research. * Flexible schedule * Remote work * Opportunity to contribute to improving LLMs.