History Expert for AI Evaluation

You will create and assess evaluation data for AI models. Your work will turn historical methods into clear reasoning tasks and help measure whether model responses use evidence responsibly.

You will need to distinguish persuasive historical analysis from confident claims that lack support.

• Write historical scenarios covering source criticism, methodological reasoning, and competing explanations of causes.
• Create reference answers that explain how evidence supports or limits each interpretation.
• Rate model responses for factual accuracy, historical context, and awareness of historiography.
• Flag responses that flatten evidence, invent causation, or apply present-day assumptions inaccurately to the past.

This is a fully remote, asynchronous independent contractor role. Work can scale up or down from week to week.

• Pay: $50 to $100 per hour, paid weekly via Stripe.
• Time: 20 or more hours per week.
• Location: Open to candidates in the eligible countries listed for this role.
• Language: Clear written English.
• Education: An advanced degree in history or a closely related field.
• Experience: At least two years of teaching, research, archival, or published historical work.
• Subject knowledge: Depth in a historical period or region and experience working with primary sources.
• Skills: Weigh conflicting sources and explain plainly what the evidence establishes.
• Helpful background: A PhD with peer-reviewed publications, archival research, public history, or reading knowledge of relevant research languages.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind systems that learn from examples, including writing and rating model responses. People with strong subject knowledge help evaluate whether AI handles specialized topics accurately and responsibly.