AI Quality Analyst, Personalization (Polish)

You will test and review AI responses that use personal context to make conversations more relevant and helpful. You will create realistic multi-turn conversations, judge the results, compare model outputs, and record structured feedback.

• Create multi-turn prompts based on personal experiences and information.
• Check whether responses use available context correctly and naturally.
• Identify unsupported inferences, hallucinations, forced connections, and other personalization problems.
• Compare and rank two responses for helpfulness, ease of use, enjoyment, and overall quality.
• Write clear rationales that refer to specific turns in each conversation.
• Review debugging information and data-source use, then delete evaluation conversations to keep chat history clean.

This is a one-month remote contractor engagement focused on Polish-language AI evaluation. The work is open worldwide where permitted.

• $20 per hour.
• At least 20 hours per week, with availability of at least 4 hours per day and up to 40 hours per week.
• Four hours of overlap with Pacific Time is required.
• Professional ability to read and write in Polish.
• Strong analytical judgment for nuanced or unclear AI responses.
• Ability to create creative multi-turn prompts based on personal context.
• Clear, structured writing and close attention to detail.
• A bachelor's degree or equivalent experience in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field is helpful.
• Experience in data annotation, AI quality evaluation, content moderation, or related work is preferred.
• Reliable computer equipment and internet access.
• Willingness to use a primary personal Google account and relevant personal data sources for evaluation.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind systems that learn from examples, including reviewing model responses and rating which answers are more useful. OpenTrain is a platform where people find AI training and data-labeling roles, build a profile, and start applications.