The work
Create and improve software engineering examples used to train and evaluate AI coding systems. You will apply full-stack engineering judgment to code review, solution development, and model evaluation.
- Curate code examples and correct solutions in Python, JavaScript, React, Node.js, C/C++, Java, Rust, and Go.
- Review AI-generated code for efficiency, scalability, reliability, and quality across frontend and backend work.
- Build agents and automated checks to find error patterns and verify software solutions.
- Assess AI coding systems across prototyping, architecture and API design, production implementation, launch, experimentation, monitoring, and ongoing operations.
- Work with cross-functional teams to improve AI coding solutions against industry benchmarks.
What it pays and takes
- Pay: Not provided.
- Hours: At least 20 hours per week.
- Location: Open to candidates in the United States.
- Engagement: Part-time contractor role with an initial one-month term and possible extensions based on performance and fit.
- Skills: Strong full-stack development experience with Python and JavaScript, including React and Node.js, plus experience deploying production-grade software.
- Skills: Deep knowledge of software architecture, design, development, debugging, and code review.
- Communication: Strong written and spoken English, including the ability to explain evaluations clearly and in a structured way.
- Helpful background: Experience shipping high-impact products in a fast-moving engineering environment, strong computer science foundations, and production systems experience. Demonstrated engineering ability matters more than academic background.