The work
You will assess how well an AI system uses personal context in multi-turn conversations. Your reviews will focus on whether responses are helpful, natural, accurate, properly supported, and appropriate for the information available.
- Create prompts based on personal experiences that require the AI system to use relevant personal context.
- Review responses for unsupported claims, hallucinations, incorrect personalization, weak inferences, forced connections, and unnatural overnarration.
- Compare responses side by side and rank them for helpfulness, ease of use, and overall quality.
- Write clear rationales that refer to specific conversation turns and explain strengths and issues.
- Review debugging information to check whether conversation summaries and relevant data sources were used correctly.
- Provide detailed annotations and constructive feedback.
What it pays and takes
This is a remote contractor engagement for one month. The project supports a global operations team and includes scheduled overlap with Pacific Time.
- Pay: $20 per hour.
- Schedule: 20 or more hours per week, with an expected commitment of at least 4 hours per day and up to 40 hours per week.
- Time zone: 4 hours of overlap with Pacific Time is required.
- Location: Open worldwide.
- Language: Strong Dutch reading and writing ability is required.
- Education: A bachelor’s degree or equivalent experience in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field is requested.
- Experience: Experience in data annotation, AI quality evaluation, content moderation, or related work is helpful.
- Skills: Strong analytical judgment, creative multi-turn prompt writing, careful evaluation of nuanced responses, and clear structured writing.
- Equipment: A desktop or laptop and reliable internet connection are required.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
AI training is the human work behind systems that learn from examples, including writing prompts, reviewing model responses, and rating which answers work best. People with strong language, analytical, or subject knowledge help make these systems more accurate, useful, and responsible. You can create a free OpenTrain account to find projects and build an AI training profile.