The work
As an AI Quality Analyst, you will test and rate a personalization feature using Thai-language conversations and personal context. You will check whether the AI uses information from past chats and connected activity in a relevant, accurate, and natural way.
- Create and run multi-turn prompts lasting one to five turns that require the AI to use personal information and experiences.
- Review responses against the intent of the starting prompt and assess whether the personalization is appropriate.
- Check responses for grounding problems, poor use of connected data, and overall helpfulness.
- Compare two AI responses side by side and rank which is more helpful, natural, easy to use, and enjoyable.
- Write clear reasons for your rankings and refer to specific conversation turns.
- Extract and verify debug information to confirm that chat summaries and data sources were used correctly.
- Delete evaluation conversations to protect data quality and prevent them from affecting future chat history.
What it pays and takes
This is an intermediate-level, remote contract role focused on Thai-language AI evaluation. You must be comfortable judging nuanced responses and explaining your decisions in clear written Thai or English as required by the project.
- Pay: $15 per hour.
- Time: 20+ hours per week.
- Location: Worldwide and fully remote.
- Language: High-level Thai reading and writing ability.
- Equipment: A desktop or laptop with a reliable internet connection.
- Personal data: Willingness to use your primary personal account and enable personal data sources for a genuine evaluation.
- Core skills: Analytical thinking, creative prompt design, careful side-by-side review, and strong written communication.
- Helpful background: A degree or equivalent experience in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field.
- Helpful experience: Data annotation, AI quality evaluation, content moderation, or similar work.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
AI training work is the human work behind systems that understand language and generate responses. People write prompts, review outputs, and explain what makes one answer more useful so AI systems can improve.