Language Model Evaluation Expert

You will evaluate AI-generated Slovenian content and create reference material used to improve language models. The work combines linguistic review, writing, fact-checking, rewriting, and comparison of multiple model responses.

You will work across general knowledge, customer support, education, conversational writing, translation, localization, and culturally sensitive content.

• Review Slovenian outputs for accuracy, fluency, spelling, grammar, tone, register, cultural fit, and prompt adherence.
• Find mistranslations, unclear wording, terminology issues, logical inconsistencies, factual errors, bias, and unsafe or culturally inappropriate language.
• Write clear feedback explaining each problem and how to fix it.
• Create prompts, reference answers, rewrites, and model answers in Slovenian.
• Rate and rank responses for correctness, meaning preservation, terminology, register, and overall quality.

This is a remote, part-time contractor role for candidates in Slovenia. The schedule is flexible, with an estimated commitment of about 20 hours per week over 1 to 3 months.

• Pay: Up to $25 per hour.
• Location: Open to candidates in Slovenia.
• Languages: Fluent Slovenian and professional English at a minimum C1 level.
• Schedule: About 20 hours per week for 1 to 3 months, with flexible scheduling.
• Education: A bachelor's degree or higher in linguistics, Slovenian language or literature, English literature, communications, journalism, translation, or a related field, or equivalent professional experience.
• Experience: At least 3 years in writing, editing, localization, translation, content quality assurance, journalism, education, or related language-focused work.
• Knowledge: Slovenian grammar, spelling, punctuation, diacritics, cases, declension, conjugation, dual number, word order, tone, and style.
• Judgment: Ability to distinguish formal, neutral, conversational, professional, educational, and public-facing registers.
• Helpful background: AI data training, data annotation, translation quality assurance, editorial quality assurance, localization quality assurance, or rubric-based evaluation.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind systems that generate and understand language. Contributors review model responses, write examples, and explain what good output looks like, while OpenTrain helps people find these roles and apply through one profile. Experience in language and editing matters because careful human feedback helps models produce clearer, safer, and more accurate results.