The work
You will help teams apply detailed annotation and chatbot evaluation guidelines consistently. The role combines quality review, reviewer support, project setup, and final assessments of chatbot outputs.
- Turn complex project guidelines into clear instructions for annotation teams.
- Check project setup before production begins.
- Lead calibration sessions and document decisions on escalated cases.
- Mentor QA leads and annotation teams through feedback and review.
- Support pilot teams testing new task templates.
- Identify high-performing reviewers and analyze audit results.
- Recommend improvements to guidelines and training.
- Compare multiple chatbots and provide final assessments for defined evaluation tasks.
What it pays and takes
Pay details are not provided for this listing. The role is remote and project-based, with part-time contractor work supporting AI quality and evaluation projects.
- Work arrangement: Fully remote and open worldwide.
- Time requirement: 20+ hours per week.
- Language: Professional fluency in English.
- Experience level: Entry level.
- Experience: Four to six years of overall professional experience, including at least two years leading QA reviewers.
- Strong experience auditing work against detailed guidelines.
- Excellent judgment when handling complex or ambiguous cases.
- Clear communication and documentation skills.
- Experience with annotation, data labeling, AI training data, or multimodal projects is helpful.
How it works
Apply on OpenTrain with your resume and then complete the application on the hiring site.
About AI training work
AI training work is the human side of building artificial intelligence. People prepare and review examples, rate model responses, and assess outputs so AI systems can produce more useful results; experienced reviewers are valuable when projects require careful judgment and consistent quality decisions.