The work
Create and assess coding datasets used to train and evaluate large language models. You will use Python most often, with work also spanning JavaScript, ReactJS, C/C++, Java, Rust, and Go.
- Curate code examples, write solutions, and correct code for training datasets.
- Review AI-generated code for efficiency, scalability, reliability, and quality.
- Build Python agents and automated checks to find error patterns and validate solutions.
- Evaluate AI capabilities across prototyping, architecture and API design, production implementation, launches, experiments, monitoring, and operational maintenance.
- Design ways to verify software engineering tasks and write clear reasons for your evaluations.
What it pays and takes
- Pay: Not provided.
- Hours: 20+ hours per week.
- Location: Open to candidates based in the United States.
- Engagement: Individual contractor role, initially one month, with possible extensions based on performance and fit.
- At least three years of software engineering experience and deep Python expertise, including production frameworks and tools.
- Experience building full-stack applications and deploying scalable software.
- Strong knowledge of software architecture, design, development, debugging, and code review.
- Working ability in JavaScript, ReactJS, C/C++, Java, Rust, or Go.
- Strong written and spoken communication skills for explaining technical judgments.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.