The work
You will create and review code examples used to train and benchmark AI models. The work calls for production engineering judgment across full-stack software.
- Curate code examples and develop precise solutions for AI training projects.
- Correct and refine backend and frontend code using Python, JavaScript, React, Node.js, C/C++, Java, Rust, and Go.
- Rate AI-generated code for architecture, efficiency, scalability, reliability, and production readiness.
- Build agents and automated checks that assess code quality and identify error patterns in full-stack applications.
- Evaluate model abilities across prototyping, architecture and API design, implementation, launch, experimentation, monitoring, and operational maintenance.
- Work with cross-functional teams on industry performance benchmarks.
What it pays and takes
- Pay: Not specified.
- Time commitment: 20+ hours per week.
- Location: Open to candidates based in the United States.
- Engagement: Individual contractor role, initially one month, with possible extensions based on performance and fit.
- Required experience: At least three years in software engineering, including strong full-stack development with Python and JavaScript, React, and Node.js.
- You should have experience deploying scalable, production-grade software and deep knowledge of software architecture, design, development, debugging, and code review.
- You should be able to assess code systematically and explain your decisions clearly in writing and conversation. Fluency in English is required.
- Experience building production systems at high-scale engineering organizations is helpful. Computer science or related academic preparation is also helpful; demonstrated engineering skill and experience are the main considerations.