Senior Backend Engineer (Python/FastAPI) AI Evaluation

You will create and evaluate software engineering data used to train and benchmark large language models. The work combines backend engineering, code correction, structured evaluation, and automated testing.

• Curate Python code examples for backend services, data pipelines, and machine learning infrastructure.
• Build solutions, correct AI-generated code, and improve implementations for quality and reliability.
• Create Python agents and automated verification tools that find error patterns and test solution quality.
• Evaluate model capabilities across prototyping, architecture, API design, production implementation, launches, experiments, monitoring, and operational maintenance.
• Design ways to automatically verify solutions to software engineering tasks.
• Contribute coding solutions measured against industry performance benchmarks.

The role is a flexible contractor engagement for professionals based in the United States. The initial engagement lasts one month, with possible extensions based on performance and fit.

• Location: Open to candidates in the United States.
• Time requirement: 20+ hours per week.
• Engagement: Contractor and part time.
• Experience: At least three years of software engineering experience.
• Technical skills: Strong Python expertise, including production frameworks and tooling, plus experience building full-stack applications and deploying scalable software.
• Engineering knowledge: Architecture, design, development, debugging, and code quality assessment.
• Evaluation skills: Ability to write clear, structured explanations for technical evaluations.
• Additional experience with JavaScript, ReactJS, C, C++, Java, Rust, or Go is valuable.
• Experience shipping high-impact products in a fast-moving engineering environment is helpful.
• Language: Professional fluency in English.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind systems that learn from examples, including reviewing code and rating model outputs. Experienced software engineers help assess whether generated solutions are correct, reliable, efficient, and ready for real use.