The work
You will work on software engineering datasets and evaluate AI-generated code. The duties and qualifications described below need review before applying.
- Curate code examples and create precise solutions to software engineering tasks.
- Review and refine AI-generated code for efficiency, scalability, reliability, and quality.
- Build Python agents and automated tools to find error patterns, assess code quality, and verify solutions.
- Assess model capabilities across prototyping, architecture, API design, production implementation, launch, experimentation, monitoring, and ongoing maintenance.
- Work with cross-functional teams to improve AI coding solutions against industry benchmarks.
What it pays and takes
- Location: Remote, open to candidates based in the United States.
- Schedule: Flexible, with a requirement of 20 or more hours per week.
- Engagement: Part-time contractor role for one month, with possible extensions based on performance and fit.
- Skills: Strong Python knowledge, including production-grade frameworks and tools; experience building full-stack applications and deploying scalable software.
- Skills: Knowledge of software architecture, design, development, debugging, and code review assessment.
- Languages: Fluent in English, with clear written and spoken communication for explaining evaluation decisions.
- Additional useful experience: JavaScript, ReactJS, C/C++, Java, Rust, or Go.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.