LLM Code Evaluation Software Engineer

You will help create datasets used to train and test large language models. The work includes curating code examples, writing accurate solutions, correcting code, and evaluating whether AI-generated code is reliable, efficient, and scalable.

You will also design ways to verify software engineering solutions automatically, build agents that find code errors, and assess how well models perform at different steps of the software development process. You will work with researchers and other teams to improve AI coding systems against industry benchmarks.

• Create code examples and solutions in Python, JavaScript, ReactJS, C, C++, Java, Rust, and Go.
• Review and improve AI-generated code for quality, efficiency, scalability, and reliability.
• Build verification agents that check code and identify common error patterns.
• Design automated checks for software engineering tasks.
• Write clear, structured explanations for your evaluations.
• Help assess model performance across the software engineering cycle.

Pay details are not provided in the listing. This is a part-time contractor role with a one-month initial duration and possible extensions based on performance and fit.

• Hours: 20 or more per week, with a flexible commitment.
• Location: Open to candidates in the United States, Canada, Austria, Belgium, France, Germany, Liechtenstein, Luxembourg, Monaco, the Netherlands, or Switzerland.
• Language: Professional fluency in English.
• Experience level: Entry level.
• Strong skills in full-stack application development and production software deployment.
• Knowledge of software architecture, design, development, debugging, code quality, and code review.
• Strong oral and written communication skills.
• Experience with large language model evaluation or AI model training is helpful.
• Contractor role with no medical or paid leave.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training work uses human-written examples, reviews, and evaluations to help artificial intelligence systems produce better results. Software engineers are needed for coding projects because their technical judgment helps identify correct solutions, explain errors, and test whether model-generated code works as intended.