AI Quality Analyst (Personalization, Vietnamese)

You will evaluate how a conversational AI feature uses personal context from earlier conversations and connected activity. Your work combines Vietnamese language judgment, prompt design, response comparison, and structured feedback for AI training.

• Create and run conversational prompts based on personal experiences across about one to five turns.
• Check whether personalization matches the prompt and is supported by evidence.
• Identify incorrect personalization, weak inferences, hallucinations, forced connections, and robotic overnarration.
• Compare two model responses and decide which is more helpful, natural, easy to use, and enjoyable.
• Write concise reasons for your rankings, referring to specific conversation turns.
• Review debug information to confirm that summaries and relevant data sources were used correctly.
• Delete evaluation conversations as required for careful data handling.

This is a remote, three-month contractor engagement focused on Vietnamese-language evaluation. The role is listed at an intermediate experience level.

• $15 per hour.
• 20+ hours per week, with full-time availability, at least 4 hours per day, and up to 40 hours per week.
• Four hours of schedule overlap with Pacific Time.
• Strong Vietnamese reading and writing ability.
• Excellent judgment when reviewing nuanced or ambiguous AI responses.
• Ability to design creative multi-turn prompts using personal context.
• Understanding of personalization quality, grounding, integration, and helpfulness.
• Clear, structured writing and precise references to conversation turns.
• Independent work habits, strong communication, and reliable computer and internet access.
• Access to a desktop or laptop with a reliable internet connection.
• Willingness to use a primary personal Google account and enable relevant personal data sources for evaluation.
• A BA or BS, or equivalent experience, in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field is helpful.
• Experience in data annotation, AI quality evaluation, content moderation, or similar review work is preferred.

You apply on OpenTrain with your resume and then complete the application on the hiring site.

AI training is the human work behind systems that write, understand, and respond to people. Contributors review examples and model responses so AI systems become more accurate, useful, and natural; people with strong language or analytical skills are paid for this careful judgment. OpenTrain helps people find these projects, build a profile, and apply in one place.