The work
You will evaluate code patches generated by large language models for open source repositories. Your reviews will help assess whether proposed changes are correct, useful, and suitable for the repository.
You will also review work submitted by other subject-matter experts and explain your decisions in clear written feedback.
- Review generated code patches for open source repositories.
- Assess proposed changes using software engineering judgment.
- Write detailed feedback that clearly supports each assessment.
- Review evaluations submitted by other subject-matter experts.
- Help produce consistent assessments for AI system training.
What it pays and takes
- Pay: $150 to $300 per hour equivalent, paid per task that meets project specifications.
- Schedule: Flexible scheduling with expected availability of 15 hours per week.
- Work arrangement: Globally remote for candidates in the countries listed for this role; this opportunity is not worldwide.
- Language: Fluent in English.
- Experience: The role is marked as entry level.
- Requirements: Active or demonstrable experience maintaining an open source repository.
- Requirements: A clear GitHub or GitLab profile showing open source contributions.
- Requirements: Experience reviewing code submitted by contributors.
- Requirements: Strong written communication for explaining technical decisions.
- Requirements: Senior-level software engineering expertise across relevant programming environments.
- Helpful background: Experience with active contributor communities, pull requests, and languages such as Python, C, C++, Java, TypeScript, Rust, or Go.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
AI training is the human work behind systems that learn from examples. People review code, text, images, audio, or model responses so AI systems can improve, and specialized contributors are paid for applying relevant professional knowledge.