The work
Create and assess coding examples used to train and benchmark large language models. You will use software engineering judgment to review code and evaluate model capabilities.
- Curate code examples and develop solutions in Python, C/C++, Rust, Go, Java, and JavaScript, including ReactJS.
- Correct and refine AI-generated code, then assess solutions for architecture, API design, production use, monitoring, and maintenance.
- Evaluate performance against technical benchmarks and build agents that find patterns in errors.
- Design ways to verify software engineering solutions and work with technical teams to improve AI coding systems.
Requirements and schedule
- Strong skills in systems programming, infrastructure, or backend development, especially with Python, C/C++, Rust, or Go.
- Experience building and deploying scalable, production-grade software.
- Knowledge of software architecture, design, development, debugging, and code review.
- Clear written and spoken communication, with the ability to explain technical evaluations in a structured way.
- The role is open to candidates in the United States and requires at least 20 hours per week.
- This is a part-time contractor role. Experience building production systems at a high-scale engineering organization and a strong computer science foundation are helpful.
How to apply
Apply on OpenTrain with your resume, then complete the application on the hiring site. OpenTrain is a platform where people can find AI training projects, build a profile, and apply; creating an account is free.