About this role
Role Type: Contractor (~15 hs a week)
Location: Remote, worldwide
micro1 is engaging Research Evaluation Specialists (PhD or Masters / Researcher) to contribute expert insight in developing rigorous test material for advanced AI model evaluation as part of a customer's project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Prior experience in AI is required while your domain knowledge brings high value.
Scope of Work
- Create original, high-difficulty question-and-answer pairs at the cutting edge of your discipline to rigorously assess AI model capabilities.
- Source, verify, and thoroughly document answers using primary sources and authoritative references, including clear citations and reasoning.
- Design questions demanding advanced reasoning, methodological nuance, or synthesis across multiple sources, ensuring resistance to oversimplified or shortcut solutions.
- Test questions against AI systems, identify items that are not sufficiently challenging, and iteratively increase complexity while maintaining accuracy.
- Write each question and answer with high precision and clarity, eliminating ambiguity and supporting defensible responses.
- Integrate reviewer feedback and consistently uphold all project guidelines and quality standards throughout your deliverables.
Preferred Qualifications
- Masters or PhD completed, active candidacy, or equivalent research experience as a specialist, researcher, assistant professor or professor in your domain.
- Demonstrated track record of scholarly research, in-depth subject matter expertise, and familiarity with primary literature.