AI Personalization Quality Analyst (Portuguese)

You will evaluate how conversational AI uses personal information and past experiences to make replies more relevant and helpful. The work combines prompt writing, response review, side-by-side ranking, and clear written feedback.

• Create and run realistic multi-turn prompts, usually one to five turns, based on personal experiences.
• Check whether responses follow the original prompt and use personalization appropriately.
• Review claims about the user for evidence, accuracy, and unsupported or flawed inferences.
• Identify forced connections, unnecessary repetition, and other problems with how personal information is used.
• Compare responses side by side and rank them for helpfulness, usability, enjoyment, and overall quality.
• Write concise rationales that point to specific conversation turns and explain each response's strengths and weaknesses.

This is a part-time contractor role for an intermediate-level contributor. You can work worldwide, provided you meet the language and work requirements below.

• Pay: $15 per hour, paid in USD.
• Time: 20 or more hours per week.
• Language: Strong Portuguese reading and writing ability.
• Work setup: Reliable computer and internet access, independence, and effective remote communication.
• Core skills: Strong analytical judgment, attention to detail, creative prompt writing, and clear, structured written communication.
• Knowledge: Understand grounding, incorrect personalization, poor inferences, forced connections, and naturalness in AI responses.
• Helpful background: A bachelor's degree or equivalent experience in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field.
• Preferred experience: Data annotation, AI quality evaluation, content moderation, or related work.

Apply on OpenTrain with your resume and then complete the application on the hiring site.

AI training is the human work behind systems that learn from examples, including writing and rating model responses. Careful reviewers are paid to judge whether AI outputs are accurate, useful, natural, and grounded in the information provided.