German Voice AI Evaluator (Healthcare Conversations) – Remote from Poland

What if your native German fluency could help teach AI how to handle a real phone call to a doctor's office? We're looking for native German speakers based in Poland to hold natural spoken conversations with an AI healthcare receptionist, then evaluate how well it listens, responds, and takes action.

You'll role-play as a patient using fictional personas we provide, record short conversations, and grade the AI's performance. This is a fully remote, flexible contract role for people with clear German speech, sharp attention to detail, and an ear for what sounds natural and authentic.

• Organization: Alignerr
• Type: Contract (task-based)
• Location: Remote
• Commitment: Flexible, work at your own pace

• Hold 4 to 5 minute spoken conversations in German with an AI front desk assistant, playing a fictional patient
• Say natural trigger phrases to test whether the AI makes the correct function calls — for example, checking a patient record, booking an appointment, or verifying insurance
• Review transcripts and classify how accurately the AI understood you and responded
• Flag issues such as mispronunciations, cutoffs, interruptions, delays, and incorrect function calls, including timestamps
• Test how the AI handles background noise, short replies such as "ja," "nein," or "okay," long numbers, emotional moments, and sensitive or unsafe requests
• Follow detailed labeling guidelines consistently and submit high-quality work

• Native or near-native German speaker with a clear, natural speaking voice
• Detail-oriented, with the patience to review recordings and transcripts closely
• Comfortable role-playing a patient and sounding authentic in conversation
• Able to follow multi-step instructions and apply them consistently
• Reliable and self-directed when working independently
• Access to a quiet space, a good microphone, a stable internet connection, and a second device for playing background noise
• Comfortable using web-based tools

• Experience in voice AI evaluation, data annotation, or QA testing
• Background in healthcare administration, customer service, or call centre work
• Familiarity with spoken German variants across Germany, Austria, and Switzerland
• Linguistics or language-focused academic background
• Familiarity with medical terminology in German

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Task-based work with real autonomy
• Directly help make voice AI more accurate, natural, and safe in healthcare settings
• Potential for ongoing work as new projects launch

Note: New contributors complete a short unpaid qualification assessment. Contributors who pass are added to paid production work.