The Work
You will test how well conversational AI uses personal context. You will create multi-turn prompts, review responses, compare outputs, and explain your judgments in clear written feedback.
- Create and run conversational prompts that usually span one to five turns and are grounded in personal experiences.
- Check whether responses follow the prompt, use relevant information correctly, and apply personalization naturally.
- Identify unsupported claims, incorrect inferences, hallucinations, forced connections, and unnecessary explanations.
- Compare responses side by side for helpfulness, usability, naturalness, accuracy, and overall quality.
- Write concise, evidence-based rationales that refer to specific conversation turns and give constructive feedback.
- Review debugging information to confirm that summaries and relevant data sources were used correctly.
- Delete evaluation conversations after review to maintain data hygiene.
What It Pays And Takes
This is a remote, part-time contract role open worldwide. The work requires at least 20 hours per week and strong Spanish reading and writing ability.
- Pay: $15 per hour.
- Time: 20+ hours per week.
- Location: Remote and open worldwide.
- Language: Strong Spanish reading and writing ability.
- Experience level: Intermediate.
- You should be able to analyze nuanced or unclear AI responses and recognize incorrect personalization, poor inferences, and forced connections.
- You need clear, structured written communication, close attention to detail, and the ability to work independently.
- You need a reliable computer and internet connection.
- You must be willing to use a primary personal Google account and enable relevant personal data sources for evaluation.
- A bachelor's degree or equivalent experience in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field is helpful but not required.
- Experience in data annotation, AI quality evaluation, content moderation, or related work is valuable.
How It Works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI Training Work
AI training is the human work behind artificial intelligence. People create examples, review model responses, and give feedback so AI systems become more accurate, useful, and natural. OpenTrain helps people find these roles, build a profile, and apply to projects in one place.