Political Science LLM Evaluation Expert

You will help evaluate and improve large language models using your knowledge of political systems, governance, elections, public policy, international relations, and related subjects. Your reviews must judge whether model responses are accurate, well-reasoned, complete, nuanced, and current.

The work combines political research judgment with AI evaluation, benchmark development, adversarial testing, annotation quality, and clear documentation.

• Create advanced prompts about political science, governance, elections, public policy, and international relations.
• Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
• Find hallucinations, logical inconsistencies, outdated information, and difficult edge cases.
• Develop benchmark datasets and adversarial test cases.
• Give objective feedback supported by reliable references.
• Work with AI researchers to improve model performance.
• Maintain high annotation quality and clear documentation.

The listing does not specify a pay rate. This is a contractor assignment scheduled for eight weeks. The structured listing marks it as part-time with a 20+ hour weekly commitment, while the engagement details require 40 hours per week.

• Hours: 40 hours per week, including at least four hours of overlap with Pacific Time.
• Schedule: Eight-week engagement.
• Location: Worldwide.
• Language: Excellent written English.
• Education: A master's degree or higher in any field is required.
• Experience: At least three years in political research, public policy, government, political consulting, academia, journalism, international affairs, think tanks, or a related area.
• Knowledge: Political institutions, comparative politics, governance, elections, public policy, and current global political developments.
• Core skills: Research, analysis, documentation, attention to detail, and identifying factual inconsistencies and weaknesses in reasoning.
• Preferred education: Political science, public policy, international relations, government, public administration, law, economics, journalism, or another politics-related field.
• Helpful background: Large language models, generative AI, prompt engineering, AI evaluation, published research, teaching, or industry recognition.
• Work style: Ability to work independently and produce objective, evidence-backed reviews.

Apply on OpenTrain with your resume and then complete the application on the hiring site.

AI training is the human work behind systems that learn from examples, including writing prompts and reviewing model responses. People with strong subject knowledge are paid to catch errors, judge reasoning, and help make AI outputs more accurate and useful.