The Work
You will test a personalization feature through short, multi-turn conversations and judge how well the model uses personal information. You will compare responses, explain your decisions, and check that the right data sources were used.
You will also remove evaluation conversations after review to keep the data organized.
- Write and run conversations lasting 1 to 5 turns.
- Evaluate responses for grounding, integration, and helpfulness.
- Rank two responses side by side by overall quality.
- Write clear reasons that refer to specific conversation turns.
- Extract and verify debugging information about data sources.
- Delete evaluation conversations after completing reviews.
What It Pays And Takes
This is a contractor, part-time role for an entry-level contributor. A relevant bachelor's degree is helpful but not required based on the listed requirements.
- Pay: $15 per hour.
- Time: 20 or more hours per week.
- Availability: Full-time availability with 4 hours of overlap with Pacific Standard Time.
- Location: Open worldwide.
- Language: Hindi proficiency in reading and writing.
- Skills: Analytical and critical thinking, prompt engineering experience, and excellent written communication.
- Helpful background: A bachelor's degree in a relevant field, data annotation, AI quality evaluation, or content moderation experience.
How It Works
You apply on OpenTrain with your resume and then complete the application on the hiring site.
About AI Training Work
AI training is the human work behind systems that learn from examples, including writing prompts and reviewing model responses. People with strong language, analytical, or subject knowledge help make these systems more accurate and useful, which is why this work can value specialized experience.