AI Quality Analyst (Gemini) (Chinese)

You will evaluate a conversational AI personalization feature. The work combines creative prompt writing, careful response comparison, and clear written feedback. The duties and qualifications should be reviewed before applying because the role title and project description use different role names.

You will create conversations based on personal experiences, assess whether the model uses user context correctly, and document evidence for each judgment. You will also inspect debug information and delete evaluation conversations after review.

• Create and run conversational prompts that usually span one to five turns.
• Check whether claims about a user are supported by evidence or rely on hallucinations, incorrect inferences, or forced connections.
• Compare responses for helpfulness, ease of use, enjoyment, naturalness, and appropriate use of context.
• Write concise rationales that refer to specific conversation turns.
• Review debug information to confirm that summaries and relevant data sources were used correctly.
• Delete evaluation conversations after review to keep future chat history clean.

This is a remote contractor engagement lasting three months. It is open worldwide and involves Chinese-language AI response evaluation.

• Pay: $15 per hour.
• Schedule: At least 20 hours per week, including at least four hours per day and up to 40 hours per week.
• Time zone: Four hours of overlap with Pacific Time are required.
• Language: High proficiency reading and writing in Chinese.
• Prompt skills: Experience creating creative multi-turn prompts from personal context.
• Evaluation skills: Understanding of personalization quality, grounding, incorrect inferences, and forced connections.
• Communication: Strong attention to subtle differences, clear writing, detailed annotations, and constructive feedback.
• Education: A bachelor's degree or equivalent experience in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field is requested.
• Preferred experience: Data annotation, AI quality evaluation, content moderation, or a related area.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind artificial intelligence. People write prompts, review model responses, and explain what is helpful, accurate, and well supported so AI systems can improve.