The work
Evaluate AI-generated software and full-stack code examples against project guidelines. Document clear, evidence-based judgments that can help improve AI systems.
- Review code and model outputs using project rubrics.
- Create and improve code examples and solutions, correct implementations, and design ways to verify software tasks.
- Assess code quality, architecture, debugging, performance, and reliability across full-stack applications.
- Keep evaluations consistent and explain your reasoning in clear written feedback.
What the role requires
- At least three years of software engineering experience.
- Strong experience building full-stack applications with Python and JavaScript, including React and Node.js.
- Experience deploying scalable, production-grade software.
- A strong understanding of software architecture, development, debugging, and code-quality assessment.
- Clear oral and written communication for explaining evaluation decisions.
- English proficiency is required.
- Experience with C/C++, Java, Rust, or Go, production systems, automated verification, or performance and reliability benchmarks is helpful.
- Exceptional experience and skill are valued over educational background.
Schedule and location
- Open to candidates in the United States.
- Plan for at least 20 hours per week.
- This is a part-time contractor role.