Question-and-Answer Evaluation Specialist (English)

You will create difficult question-and-answer pairs that test advanced AI models across different subjects. You will research each answer carefully, compare multiple sources, and provide clear citations and explanations.

You will also test your questions against AI models, review the results, adjust the difficulty, and improve your work based on reviewer feedback and project quality standards.

• Create original questions that require analysis, synthesis, and careful reasoning.
• Research answers using multiple sources and document the methods and citations.
• Evaluate AI responses for accuracy, completeness, and quality.
• Refine question-and-answer content based on review feedback.

This is a remote, part-time contractor project with output-based compensation. Payment applies to tasks that meet the project specifications, and minimum submission requirements apply.

• Pay: $20 to $60 per hour equivalent, paid per task that meets the project specifications.
• Time: Less than 20 hours per week.
• Location: Open to candidates in the listed countries across North America, South America, Europe, Asia, Africa, and the Middle East.
• Language: Fluent written English is required.
• Requirements: Strong independent research, careful source evaluation, precise writing, detailed documentation, and the ability to create nuanced questions.
• Work style: Reliable self-direction and accountability for remote project work are important.
• Background: Advanced-degree holders and people from varied academic or professional backgrounds are welcome when they can demonstrate strong research and writing skills.

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 8 screening questions.

AI training is the human work behind systems that generate and understand text. People create examples, review model responses, and provide feedback so these systems produce more accurate and useful answers.