Humanitarian AI Evaluation Expert (English)

You will help evaluate how well AI systems reason about humanitarian scenarios. Your work will focus on civilian harm, protected persons, proportionality, legitimate activity, and humanitarian constraints.

You will create challenging cases, assess model responses, identify humanitarian risks, and record clear findings that can guide future model training and refinement.

• Create nuanced scenarios about civilian protection and humanitarian action.
• Grade AI responses for accuracy, reasoning, depth, and sensitivity to civilian-harm concerns.
• Identify excessive caution, insufficient restraint, and other humanitarian risks.
• Document ambiguous or difficult cases with clear findings and recommendations.
• Contribute International Humanitarian Law and humanitarian principles for future training.
• Maintain precise, context-rich evaluation records.

This is a part-time contractor opportunity. The work requires practical humanitarian judgment and a strong understanding of International Humanitarian Law and civilian-protection principles.

• Pay: $30 to $70 per hour.
• Work type: Part-time contractor role.
• Location: Open to candidates in the countries listed for this opportunity, including the United States, Canada, France, Germany, India, Japan, Kenya, Nigeria, Singapore, South Africa, and Vietnam.
• Language: Professional fluency in English, including clear written and spoken communication.
• Required background: Humanitarian operations, protection, or policy experience.
• Required knowledge: International Humanitarian Law, civilian-protection principles, and proportionality reasoning in conflict or protection scenarios.
• Helpful experience: Teaching, training, field leadership, documenting difficult cases, or disseminating International Humanitarian Law.
• Valuable background: Work with the ICRC or Red Cross, UN agencies, major NGOs, conflict-zone fieldwork, or protection-cluster participation.
• Prior AI experience is not required.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind systems that learn from examples and expert feedback. In this role, your humanitarian judgment helps assess whether AI responses are accurate, well-reasoned, and appropriately sensitive to civilian protection.