LLM Evaluation Analyst (Italian)

You will evaluate Italian and English content to help improve large language models. The work combines research, reasoning, writing, and detailed feedback on challenging questions and examples.

• Break large amounts of Italian and English content into clear, logical sections.
• Research information online and check whether claims are accurate.
• Answer questions involving data interpretation, logical reasoning, analysis, and basic arithmetic.
• Create scenarios and examples that help language models learn.
• Write correct answers, explanations, constructive feedback, and detailed annotations.
• Use creative and lateral thinking when problems are unclear or difficult.

The listing does not provide a pay rate. This is a remote contractor assignment with flexible working hours and a part-time arrangement.

• Hours: 20 or more per week.
• Location: Remote and open worldwide.
• Languages: Professional fluency in Italian and English.
• Experience: Entry level; professional writing experience in business analysis, research, journalism, technical writing, editing, translation, or a related area is helpful.
• Skills: Strong research, analytical, critical-thinking, communication, data interpretation, logical reasoning, and clear written explanation skills.
• Work style: Ability to work independently in a remote setting.
• Education: A bachelor's degree or undergraduate study in engineering, literature, journalism, communications, arts, statistics, or a related field is helpful. Relevant experience may also be considered.
• Tools: Familiarity with Excel and Google Suite is useful.
• Equipment: A desktop or laptop with a reliable internet connection.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind systems that write, answer questions, and understand language. Contributors review examples, rate model responses, and explain what makes an answer accurate or useful so models can improve. People with strong writing, research, reasoning, or subject knowledge are often suited to specialized evaluation work.