Python Full-Stack (JS) Developer, AI Evaluation

You will build and review software used to train and improve AI models. The work combines Python and JavaScript or TypeScript development with model evaluation, response ranking, dataset creation, and human feedback workflows.

You will also help assess broader user-query tasks, explain your decisions clearly, review code and documentation, and provide feedback that supports accurate, useful, and responsible model behavior.

The role title identifies a Python and full-stack JavaScript developer position. Review the duties and qualifications before applying.

• Design, develop, and maintain readable, reusable, efficient code for AI model training and optimization.
• Benchmark model performance and rank model responses against defined criteria.
• Write clear explanations and rationales for evaluation decisions.
• Create and maintain datasets for supervised fine-tuning.
• Support reinforcement learning with human feedback workflows and reward-model refinement.
• Create and improve responses used to train models.
• Develop evaluation strategies based on user needs, technical accuracy, and ethical alignment.
• Review code and documentation, provide constructive feedback, and contribute to product improvements.

The role details do not include a pay rate. It is listed as a part-time contractor position for candidates worldwide.

• Time commitment: 20 or more hours per week.
• Location: Open worldwide.
• Language: Fluent spoken and written English.
• Level: Entry level.
• Required: Strong Python and JavaScript or TypeScript skills, including familiarity with ES6 conventions.
• Required: Experience building modular, scalable web applications with attention to readability, security, stability, and testing.
• Required: Familiarity with Node.js or NestJS and React, Angular, or Vue.js.
• Required: Ability to write clean, organized, correct, and clearly annotated code.
• Required: Docker knowledge and excellent spoken and written English communication.
• Preferred: A bachelor's or master's degree in engineering or computer science, or equivalent experience.
• Helpful: Experience with software quality assurance, test planning, test-driven development, LLM prompting, code review, model evaluation, supervised fine-tuning, or RLHF.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind modern AI systems. People write, review, rank, and improve examples so models can produce more accurate and useful results. Technical contributors are valued because their software knowledge and careful judgment help evaluate code and model behavior.