The work
You will create code examples and solutions used to train and benchmark AI models. You will also review AI-generated code for correctness, efficiency, scalability, reliability, and software engineering standards.
- Build Python agents and automated tools that detect code errors and assess solution quality.
- Design ways to automatically check solutions to software engineering tasks.
- Evaluate AI coding skills across prototyping, architecture, API design, production implementation, launch, experimentation, monitoring, and maintenance.
- Work with technical teams to improve AI coding results against industry benchmarks.
What it pays and takes
- Location: Open to candidates in the United States.
- Time commitment: 20 or more hours per week.
- Work type: Contract, part-time.
- Required: At least three years of software engineering experience, strong Python skills, and knowledge of production-grade frameworks, tools, and practices.
- Required: Experience building full-stack applications and deploying scalable software, with strong skills in software architecture, design, development, debugging, and code review.
- Required: Strong written and spoken communication skills for writing clear evaluation explanations.
- Helpful: Experience with advanced AI or intelligent systems, a strong computer science foundation, and familiarity with JavaScript, ReactJS, C/C++, Java, Rust, or Go.
- Language: Fluent in English.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.