Humanitarian Aid Representative AI Evaluation Expert

You will help evaluate how AI systems reason about humanitarian situations. The work combines scenario design, response grading, expert judgment, and clear documentation grounded in International Humanitarian Law and humanitarian practice.

The job title refers to a Humanitarian Aid Representative, while the duties focus on AI evaluation. Review the duties and qualifications before applying.

• Create realistic cases involving civilian harm, protected persons, proportionality, and legitimate activity.
• Assess AI-generated responses for accuracy, reasoning depth, care, and context.
• Identify excessive caution or insufficient restraint and explain the humanitarian implications.
• Document ambiguous or difficult cases for future model training and refinement.
• Clarify humanitarian concepts and help develop guidance for IHL-related reasoning.
• Keep precise, context-rich records of findings and recommendations.

This is a remote, part-time contractor role.

• Pay: $30 to $70 per hour.
• Work arrangement: Remote, part-time contract.
• Language: Strong written and verbal English communication for complex case material.
• Location: Open to candidates in Algeria, Argentina, Austria, Bahrain, Bangladesh, Belgium, Brazil, Canada, Chile, Colombia, Denmark, Egypt, France, Germany, Ghana, Greece, India, Indonesia, Italy, Japan, Jordan, Kazakhstan, Kenya, Kuwait, Kyrgyzstan, Lebanon, Malaysia, Mexico, Morocco, the Netherlands, Nigeria, Oman, Pakistan, Palestinian Territories, Peru, the Philippines, Portugal, Qatar, Saudi Arabia, Singapore, South Africa, Spain, Sri Lanka, Switzerland, Taiwan, Thailand, Tunisia, the United Arab Emirates, the United Kingdom, the United States, Uzbekistan, and Vietnam.
• Required knowledge: Strong grounding in International Humanitarian Law and civilian-protection principles.
• Required background: Experience in humanitarian operations, protection, or policy.
• Required ability: Apply proportionality reasoning in conflict or protection scenarios.
• Required experience: Teaching, training, or leading field work related to humanitarian action or IHL dissemination.
• Helpful background: Work with the ICRC, Red Cross, United Nations agencies, or major NGOs; conflict-zone fieldwork; protection-cluster participation; or documentation of difficult humanitarian situations.
• Prior AI experience is not required.

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 5 screening questions.

AI training is the human work behind artificial intelligence. People write, review, and rate examples so models can produce more accurate and responsible responses, and subject-matter experts are needed when the work depends on careful professional judgment.