The Work
You will lead a pod of trainers who evaluate terminal-based mathematics tasks used to assess AI systems. The work covers numerical and applied mathematics, scientific computing, optimization, statistics, mathematical modeling, computational algebra, and formal verification.
You will review complete task packages and improve their technical quality. You will also give precise feedback, manage revisions through completion, mentor trainers, assign work, monitor quality, and document recurring issues and strong examples.
- Review problem statements, datasets, environments, reference solutions, and automated tests.
- Check whether tasks are well-posed and assess convergence, stability, conditioning, discretization error, numerical tolerances, and edge cases.
- Evaluate graders using residuals, feasibility, optimality certificates, invariants, error bounds, or proof checking.
- Confirm that tools, libraries, solver versions, and dependencies are pinned so tasks can be reproduced.
- Find hard-coded solutions, test leakage, and other ways to bypass the intended computation.
What It Pays and Takes
The listing does not provide a pay rate. This is a remote contractor assignment lasting four weeks, with a commitment of at least 20 hours per week.
- Work arrangement: Remote contractor assignment
- Schedule: At least 20 hours per week
- Location: Open worldwide
- Language: Professional fluency in English
- Education or experience: Ph.D., postdoctoral experience, or equivalent advanced experience in mathematics, applied mathematics, statistics, or a related field
- Programming: Strong skills in Python, Julia, C/C++, MATLAB or Octave, or a computer algebra system
- Technical skills: Strong Linux and terminal proficiency, plus hands-on experience with numerical methods, scientific computing, symbolic computation, optimization, computational statistics, or mathematical modeling
- Evaluation skills: Ability to assess derivations, algorithms, proofs, computational results, reproducibility, and test reliability
- Leadership: Strong written communication and experience mentoring or leading small technical or research teams
- Useful background: NumPy, SciPy, SymPy, mpmath, SageMath, PARI/GP, GAP, FEniCS, Firedrake, DifferentialEquations.jl, PETSc, CVXPY, JuMP, Pyomo, proof assistants, Docker, Git, continuous integration, automated testing, benchmark design, computational evaluations, or AI coding and reasoning evaluations
- Additional relevant experience: Publications or open-source contributions in computational mathematics, numerical software, or formalized mathematics
How It Works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI Training Work
AI training work uses human review to improve how artificial intelligence handles tasks such as code, mathematics, and written responses. Experienced specialists help assess whether model outputs are correct, reliable, and useful, which is why advanced subject knowledge matters for this role.
OpenTrain is a platform where people find AI training and data-labeling projects, build a profile, and apply in minutes. Creating an OpenTrain account is free.