AI Quality Analyst, Personalization (German)

You will assess how a conversational model uses information from earlier conversations and connected activity to make replies more relevant and helpful. The work requires strong German writing, careful reasoning, creative prompt design, and close review of subtle differences in AI responses.

• Create realistic multi-turn conversations, usually spanning one to five turns, using personal experiences and context.
• Check whether responses use personalization appropriately and identify unsupported claims, poor inferences, hallucinations, or forced connections.
• Rate grounding, integration, helpfulness, ease of use, enjoyment, naturalness, and overnarration.
• Compare two model responses side by side and write clear rationales that cite specific conversation turns.
• Extract and verify supporting information to check that summaries and relevant data sources were used correctly.
• Provide detailed annotations and constructive feedback, then delete evaluation conversations after review to maintain data hygiene.

This is a remote, part-time contractor engagement expected to last three months. You will work independently with a desktop or laptop and a reliable internet connection.

• Pay: $15 per hour.
• Availability: 20+ hours per week, with at least four hours per day and up to 40 hours per week available, including four hours of overlap with Pacific Time.
• Location: Open worldwide.
• Language: Strong German reading and writing ability.
• Experience level: Intermediate.
• You must be able to create creative prompts that test model behavior using personal context.
• You must recognize incorrect personalization, unsupported inferences, and unnatural use of personal data.
• You need clear, concise, structured writing and precise, evidence-based reasoning.
• You must be willing to use a primary personal account and enable relevant personal data sources for evaluation.
• A degree or equivalent experience in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field is helpful.
• Experience with data annotation, AI quality evaluation, content moderation, or similar review work is valuable.

Apply on OpenTrain with your resume, then complete the application on the hiring site. OpenTrain is a platform where people find AI training and data-labeling projects, build a profile, and start applications.

AI training is the human work behind artificial intelligence. People write prompts, review model responses, and rate quality so AI systems can give more accurate and useful answers. Experienced reviewers are paid for applying language skill, careful judgment, and subject knowledge to this process.