About this role
The research teams behind the best-known AI models come to Mercor for data judgment they can't generate on their own. Your standards and expertise become the rubric that frontier AI is graded against.
This is a standing listing for analysts and data practitioners who want AI training and evaluation work, not a specific job opening. It stays open whether or not a matching project is running this week.
New projects start on short notice, so instead of posting and pulling a listing each time, we keep one open per field and draw from it when one begins.
What the work looks like
We match data practitioners in the network to projects like
- Writing an analysis problem from work you actually shipped, with the data, the question, and the constraint, plus the reference answer a model's attempt gets graded against
- Grading model-written analysis and pipelines: whether the query answers the question that was asked, whether the join fans out, whether the metric means what the model says it means
- Flagging where a model produces a technically valid result that would mislead a decision-maker, given selection effects, leakage, or a metric that does not track the outcome
What we're looking for
- Professional experience in analytics, data engineering, statistics, or machine learning
- Clear written communication, since most of the work involves explaining your reasoning
- Comfort with ambiguous tasks, and willingness to flag unclear instructions