Intelligence Analyst (English)

You will help evaluate artificial intelligence systems using structured intelligence scenarios, analytic cases, test cases, and model-generated responses. Your work will apply intelligence tradecraft and analytic standards to judge whether responses are well supported, useful, and appropriately cautious.

• Map analytic cases to defined taxonomies across several intelligence evaluation areas.
• Write complex test cases that examine source use, analytic rigor, uncertainty, and practical usefulness.
• Assess and grade AI-generated responses against clear analytic criteria.
• Identify and document over-refusal, edge cases, analytic disagreements, and model limitations.
• Help refine source-evaluation procedures and confidence-level assignments.
• Share expert feedback that improves analytic standards and AI evaluation benchmarks.

This is remote, part-time contractor work for candidates in the countries listed for the role. English fluency is required, along with the ability to explain nuanced judgments clearly in writing and conversation.

• Pay: $30 to $80 per hour.
• Work arrangement: Remote, part-time contract.
• Location: Open to candidates across the listed countries, including the United States, Canada, the United Kingdom, India, Japan, Singapore, and South Africa.
• Language: Fluent English.
• Experience level: Entry level.
• Background: Demonstrated all-source analytic experience or deep expertise in a specific analytic discipline.
• Knowledge: Source evaluation, confidence-level assessment, established analytic standards, structured analytic techniques, and intelligence tradecraft.
• Communication: Exceptional written and verbal communication, with experience teaching, mentoring, or leading analytic reviews.
• Judgment: Ability to recognize and explain model limitations and over-refusal scenarios.
• Helpful background: Previous AI evaluation or model assessment experience is helpful but not required.

OpenTrain is where you find this role and start your application. Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind artificial intelligence, including writing test cases, rating model responses, and checking whether systems handle information accurately. People with strong subject knowledge are paid to apply careful judgment and help make AI systems more useful and reliable.