The work
You will review AI-generated code used to train and evaluate large language models. The work covers bug fixes, new features, refactoring, API integrations, configuration changes, and database operations across different programming languages and software scenarios.
You will assess whether code is correct, secure, reliable, scalable, readable, and maintainable. You will also improve code into robust reference solutions, explain recommended changes, and help create coding benchmarks and evaluation methods.
- Find functional defects, logic errors, incomplete implementations, edge-case failures, performance problems, security issues, and architecture weaknesses.
- Compare different implementations and decide which best meets the technical requirements.
- Develop evaluation criteria and technical rubrics for AI-generated code.
- Perform debugging and root-cause analysis on complex codebases.
- Give clear, structured technical feedback in written English.
What it pays and takes
This is a remote contract role for an individual contributor supporting AI training and engineering evaluation work. It is listed as part-time and requires at least 20 hours per week.
- Pay: Not provided in the role details.
- Location: Open worldwide for remote work.
- Language: Professional fluency in English for written technical feedback.
- Experience level: Entry level.
- Professional experience: At least seven years of software engineering experience.
- Programming: Strong proficiency in at least one of Python, JavaScript, TypeScript, Java, C++, Go, C#, Ruby, PHP, or Rust.
- Technical knowledge: Clean code, modular architecture, abstraction, error handling, maintainability, data structures, algorithms, APIs, databases, and application architecture.
- Required practice: Building, maintaining, debugging, and reviewing production-grade software.
- Engineering tools and methods: Collaborative code reviews, Git, and modern software engineering practices.
- Helpful background: Evaluating AI-generated code, creating technical rubrics, contributing to software engineering benchmarks, or working with multiple programming languages and architecture patterns.
How it works
Start your application on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
AI training is the human work behind modern AI systems, including reviewing model outputs, writing examples, and evaluating computer code. OpenTrain helps people find these projects, build a profile, and apply in one place; software engineers contribute the judgment needed to assess whether generated code works well and follows sound engineering practice.