The work
You will evaluate full-stack code examples and AI-generated software solutions. Your reviews will help AI systems learn from consistent technical judgment and clear written feedback.
- Evaluate model outputs using project rubrics.
- Review source materials and model outputs against project guidelines.
- Document evidence-based judgments.
- Explain your decisions clearly so feedback can improve model behavior.
- Keep your reviews consistent and accurate across repeated tasks.
What it pays and takes
The listing does not provide a pay amount. This is a flexible, part-time contractor engagement for candidates in the United States.
- Workload: 20 or more hours per week.
- Location: Open to candidates in the United States.
- Language: Fluent English for oral and written communication.
- Experience: At least 3 years of software engineering experience.
- Technical skills: Build full-stack applications with Python and JavaScript, including React and Node.js.
- Engineering knowledge: Software architecture, design, development, debugging, production deployment, scalability, and code quality review.
- Communication: Write clear, structured reasons for evaluation decisions.
- Helpful background: A strong computer science foundation, including study at institutions such as the University of Washington, University of Illinois Urbana-Champaign, UT Austin, University of Michigan, Purdue, or comparable schools. Exceptional experience and skill can also qualify you.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.