Response Evaluation Expert (Arabic and English)

You will evaluate AI-generated responses in Arabic and English and create bilingual training content. The work focuses on clear writing, careful review, and consistent judgments that can help improve AI responses.

You will use project guidelines to review source materials and model outputs, then explain your decisions in clear written feedback.

• Write or improve expert responses and explain the reasoning behind them.
• Review source materials and AI outputs against detailed project guidelines.
• Evaluate and rank responses for accuracy, fluency, context, and reasoning quality.
• Identify methodological errors, missing concepts, inaccurate claims, bias, and unclear explanations.
• Create prompts, model solutions, and bilingual examples that show correct methods.
• Explain judgments clearly to support consistent review and improve model behavior.

This is a remote, asynchronous contractor role. Prior AI training, annotation, or evaluation experience is helpful but not required, but you need strong Arabic and English skills, careful judgment, and relevant language or editorial experience.

• $15 per hour.
• 20+ hours per week.
• Open to candidates in Egypt, Saudi Arabia, and South Africa.
• Fluent Arabic with strong writing and editing skills in Modern Standard Arabic and at least one major Arabic dialect.
• C1 or higher English reading and writing proficiency for bilingual evaluation.
• At least three years of experience in translation, localization, editorial quality assurance, content quality, linguistic review, or equivalent experience.
• Relevant professional or academic expertise in linguistics, translation, Arabic language, communications, journalism, or a related field.
• Strong fact-checking habits, attention to detail, and the ability to apply detailed rubrics consistently.
• Familiarity with Arabic localization conventions for the MENA region, including terminology, formatting, and cultural nuance.
• Ability to work independently in a remote, asynchronous contractor environment.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind systems that generate and understand text. People review model responses, write examples, and give structured feedback so AI systems can produce more accurate, useful, and appropriate results.