AI Quality Analyst (Portuguese)

You will evaluate whether an AI system uses personal context correctly and naturally. You will create realistic conversations, review responses, compare alternatives, and explain your judgments in writing.

The role description focuses on personalized response evaluation under an AI quality analyst title. Review the duties and qualifications before applying.

• Create and run conversational prompts that usually cover one to five turns.
• Check whether responses follow the starting prompt and use personal context appropriately.
• Identify unsupported claims, poor inferences, hallucinations, and incorrect personalization.
• Assess whether personal information is integrated naturally rather than overexplained or presented in a robotic way.
• Compare two responses and rank them for helpfulness, ease of use, enjoyment, and overall quality.
• Write concise rationales that cite specific turns and explain each response's strengths and weaknesses.
• Verify debugging information and data-source usage, then delete evaluation conversations to keep future chat history clean.

This is an entry-level contractor engagement for three months. The work is remote and requires independent work habits, a reliable computer, and internet access.

• $15 per hour.
• 20 or more hours per week, with a stated commitment of at least four hours per day and up to 40 hours per week.
• Four hours of working-time overlap with Pacific Time.
• Open worldwide.
• Portuguese reading and writing proficiency.
• Strong analytical judgment for nuanced and ambiguous AI responses.
• Ability to create creative multi-turn prompts from personal context.
• Careful attention to naturalness, factual grounding, and overnarration.
• Clear, concise written communication and the ability to provide constructive feedback.
• A bachelor's degree or equivalent experience in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field is helpful.
• Previous work in data annotation, AI quality evaluation, content moderation, or a similar area is preferred.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind modern AI systems, including reviewing model responses, comparing outputs, and explaining which answers are accurate and useful. People with strong analytical or subject knowledge help improve how these systems respond.

OpenTrain helps people find AI training and data-labeling projects, build a profile, and apply in minutes.