The work
Create and refine code examples and software solutions for large language model training and benchmarking. Review AI-generated code and judge whether it is correct, efficient, scalable, reliable, and ready for production.
- Build Python agents and automated tools that find error patterns and check software solutions.
- Assess model-generated work across prototyping, architecture, API design, production implementation, launch, experimentation, monitoring, and ongoing operations.
- Help develop AI coding solutions and evaluate them against industry performance benchmarks.
- Write clear, structured explanations for your evaluations.
Time, location, and requirements
- Location: Open to candidates based in the United States.
- Time: At least 20 hours per week.
- Engagement: Part-time contractor role planned for one month, with possible extensions based on performance and fit.
- Bring strong Python skills, including knowledge of production frameworks, development tools, and best practices.
- Have experience building full-stack applications and deploying scalable software, with knowledge of software architecture, development, debugging, and code review.
- JavaScript and ReactJS, C/C++, Java, Rust, or Go experience is relevant.
- Be fluent in English.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.