The work
Help create and refine software examples used to train and evaluate AI models. The role focuses on Python backend services, data pipelines, and machine learning infrastructure, with work across other programming languages as needed.
The role description centers on AI code evaluation, so review the duties and qualifications before applying.
- Review and improve AI-generated code for efficiency, reliability, scalability, and production quality.
- Create clear code solutions and corrections, and curate examples for AI training projects.
- Build Python agents and automated checks that find error patterns and assess solution quality.
- Evaluate software work across prototyping, architecture, API design, implementation, launch, experimentation, monitoring, and maintenance.
- Work with teams across different functions to improve AI coding systems.
What it takes
- Location: Remote, open to candidates based in the United States.
- Schedule: Flexible, with a commitment of 20 or more hours per week.
- Engagement: Contractor, part-time; the initial term is one month, with possible extensions based on performance and fit.
- At least three years of software engineering experience and deep knowledge of Python, its frameworks and tools, and production engineering practices.
- Experience building full-stack applications and deploying software that can scale.
- Strong skills in software architecture, design, development, debugging, and code review.
- Ability to write and explain clear, well-organized evaluation reasoning.
- Experience with JavaScript, ReactJS, C/C++, Java, Rust, or Go is relevant to the broader coding work.