Linguistics AI Evaluation Expert

Help improve how AI systems handle specialized linguistic reasoning by creating expert-level problems and reviewing model responses.

• Design challenging linguistics problems and scenarios based on real analytical, corpus, and computational workflows.
• Rate AI-generated responses for accuracy, analytical rigor, and fit with professional linguistic practice.
• Write clear, structured feedback that identifies weaknesses and explains how responses can improve.
• Explain complex linguistic ideas precisely in writing.

• Pay: Up to $65 per hour.
• Hours: 20+ hours per week. This is part-time, project-based work with no set schedule; complete tasks at your own pace.
• Location: Remote, open to candidates in Germany.
• Work authorization: German work authorization is required.
• Education and expertise: A PhD or MS in Linguistics or Computational Linguistics, or comparable evidence of advanced subject expertise.
• Research: Publications and experience studying a language or linguistic phenomenon that AI systems handle poorly.
• Skills: Strong written communication and the ability to work independently in a remote, asynchronous setting.
• Language: English.
• Helpful experience includes morphology, syntax, phonology, formal grammars, corpus methods, low-resource or typologically diverse languages, phonetics, Praat, IPA, computational or NLP tools, and corpus analysis software.

Apply on OpenTrain with your resume, then complete the application on the hiring site.