Research Evaluation Specialist (PhD)

You will create original questions and defensible answers that test advanced AI systems. Your work will measure reasoning, research judgment, synthesis, accuracy, and the ability to distinguish strong evidence from shortcuts.

• Create high-difficulty questions and answers in your area of expertise.
• Research primary literature and authoritative references, documenting citations, reasoning, and supporting evidence.
• Design questions that require advanced reasoning, methodological judgment, or synthesis across multiple sources.
• Test questions against AI systems and strengthen items that can be answered through shortcuts or oversimplification.
• Write clear, precise, and unambiguous question-and-answer pairs.
• Apply reviewer feedback and follow project guidelines and quality standards.

This is independent contract work for researchers and other subject-matter specialists. Prior AI training or model evaluation experience is helpful but not required.

• $30 to $60 per hour equivalent, paid per task that meets the project specifications.
• Part-time work for fewer than 20 hours per week.
• Remote role open to candidates in the countries listed for this project across the Americas, Europe, Asia, Africa, and the Middle East.
• Fluent written English is required.
• Completed PhD, active doctoral candidacy, or equivalent research experience as a specialist, researcher, or professor.
• Deep subject-matter expertise, scholarly research experience, and familiarity with primary literature.
• Strong analytical thinking, close attention to detail, and excellent written communication.
• Experience finding and comparing information from authoritative references.
• Ability to write challenging, original, and methodologically sound questions.
• Ability to work independently and reliably in a remote setting.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training work uses human expertise to prepare and review examples that help artificial intelligence systems produce better results. Researchers are paid for this work because strong evaluation materials require careful reasoning, reliable evidence, and deep subject knowledge.