AI Quality Analyst, Personalization (Russian)

You will test how conversational AI uses personal context. You will create multi-turn prompts, review model responses, and assess whether personalization is accurate, useful, natural, and supported by evidence.

• Create and run multi-turn prompts based on personal context.
• Check whether responses follow the prompt and use relevant information appropriately.
• Identify inaccurate personalization, unsupported inferences, hallucinations, forced connections, and unnecessary narration.
• Compare and rank responses for helpfulness, ease of use, naturalness, and overall quality.
• Write concise rationales that reference specific conversation turns and explain strengths and problems.
• Review debugging information to confirm that conversation summaries and data sources were used correctly.
• Delete evaluation conversations to maintain careful data hygiene.

This is a remote, part-time contractor engagement lasting three months. The work is suitable for entry-level candidates with strong reasoning and writing skills, and relevant education or prior evaluation experience is helpful but not required.

• Pay: $15 per hour.
• Schedule: At least 20 hours per week, with availability of at least 4 hours per day and up to 40 hours per week.
• Time zone: At least 4 hours of overlap with Pacific Time is required.
• Location: Remote and open worldwide.
• Language: Proficient written and reading ability in Russian.
• Requirements: Strong analytical reasoning, careful attention to subtle differences, clear written communication, and the ability to work independently.
• Requirements: Experience creating creative multi-turn prompts from personal context and recognizing unsupported or inaccurate model claims.
• Requirements: A reliable desktop or laptop and internet connection.
• Requirements: Willingness to use a primary personal Google account and enable relevant personal data sources for evaluation.
• Helpful background: A bachelor's degree or equivalent experience in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field.
• Helpful background: Experience in data annotation, AI quality evaluation, content moderation, or related work.

Apply on OpenTrain with your resume, then complete the application on the hiring site. OpenTrain is where people find AI training roles, build a profile, and start applications.

AI training is the human work behind modern AI systems. Contributors create examples, review model responses, and explain quality issues so AI systems can produce more accurate and useful results.