The work
Curate software engineering examples and build or correct solutions for AI training and benchmarking. The role description focuses on full-stack software engineering and code evaluation, so review the duties and qualifications before applying.
- Review code for architecture, efficiency, scalability, reliability, debugging quality, and maintainability.
- Work with code in Python, JavaScript, React, Node.js, C/C++, Java, Rust, and Go.
- Build agents and automated checks to assess code quality, find recurring errors, and verify software solutions.
- Evaluate model skills across prototyping, architecture and API design, production implementation, monitoring, and ongoing maintenance.
- Compare evaluation results with industry benchmarks.
Schedule and eligibility
- Location: United States.
- Work arrangement: Remote contractor engagement.
- Time commitment: 20+ hours per week.
- Engagement length: One month, with possible extensions based on performance and fit.
Skills and requirements
- Strong full-stack development skills with Python and JavaScript, including React and Node.js.
- Experience deploying scalable, production-grade software.
- Deep knowledge of software architecture, design, development, debugging, and code review.
- Clear spoken and written communication for explaining evaluation decisions.