The work
You will turn practical machine learning experience into technical tasks that test advanced AI systems. The work includes designing tasks, preparing reproducible environments and reference solutions, and judging whether model-generated technical work is correct and reliable.
- Create realistic machine learning engineering tasks for advanced AI systems.
- Build reproducible environments, reference solutions, evaluation criteria, rubrics, and graders.
- Review model-generated Python code, experiments, analyses, and other technical deliverables.
- Identify data leakage, incorrect validation, unstable training, performance problems, and reproducibility issues.
- Assess technical submissions against clear project specifications and quality requirements.
What it pays and takes
This is a remote contractor role for an expert-level contributor with strong practical machine learning experience and the ability to set objective standards for correct technical solutions.
- $60 to $120 per hour equivalent, paid per task that meets the project specifications.
- Flexible part-time schedule, with a commitment of at least 15 hours and a listed requirement of less than 20 hours per week.
- Fully remote; open to candidates in AE, AR, AT, BD, BE, BH, BR, CA, CH, CL, CO, DE, DK, DZ, EG, ES, FR, GB, GH, GR, ID, IN, IT, JO, JP, KE, KG, KW, KZ, LB, LK, MA, MX, MY, NG, NL, OM, PE, PH, PK, PS, PT, QA, SA, SG, TH, TN, TW, US, UZ, VN, and ZA.
- Fluent in English.
- Prior paid experience training, evaluating, benchmarking, or improving AI systems.
- Strong practical Python skills.
- Hands-on experience with PyTorch, JAX, TensorFlow, scikit-learn, XGBoost, LightGBM, or comparable machine learning tools.
- Public technical evidence through repositories, model implementations, competition results, publications, technical reports, benchmarks, or open-source contributions.
- Helpful experience includes creating AI-training tasks, reference answers, rubrics, graders, or benchmark problems; reviewing technical submissions; technical competitions; machine learning research or open source; and evaluating long-horizon or agentic AI systems.
How it works
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 8 screening questions.
About AI training work
AI training is the human work behind AI systems, including writing tasks, reviewing model answers, testing code, and judging whether outputs meet clear standards. OpenTrain is a free platform where people find AI training and data-labeling projects, build a profile, and apply in minutes.