The work
You will turn real business operations workflows into realistic tasks for evaluating AI systems. The work focuses on judgment across spreadsheets, system exports, process documents, and operational reports rather than simple information lookup.
- Design multi-step business operations tasks with clear instructions and measurable outcomes.
- Create or source realistic spreadsheets, system exports, process documents, and operational reports.
- Set grading criteria so two qualified reviewers can reach the same decision about an output.
- Build exercises that test whether materials are interpreted correctly and operational decisions are sound.
- Find ambiguous or ungradable tasks before submission, then deliver approved work on schedule and at the required quality level.
What it pays and takes
This is a remote, part-time contractor role. It is open to candidates in the countries supported by the role, including markets across the Americas, Europe, Asia, Africa, and the Middle East.
- Pay: $45 to $90 per hour.
- Time: Less than 20 hours per week, with a typical commitment of approximately 10 to 15 or more hours per week.
- Language: Strong written and spoken English at B2 level or higher; C1 is preferred.
- Experience: At least five years of hands-on responsibility in business operations, operations reporting, process design, or workflow management.
- Ownership: Direct responsibility for operational work, rather than supervisory-only or adjacent experience.
- Process skills: Experience creating or using SOPs, quality assurance checklists, process documents, service-level definitions, or training assessments.
- Tools and judgment: Strong Excel skills and comfort reasoning across several documents at once.
- Helpful background: AI or large language model evaluation experience is useful but not required. Recurring operational reports, process redesign, cross-team or cross-system workflow management, data discrepancy investigations, and SOP writing are relevant experience.
How it works
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 5 screening questions.
About AI training work
AI training is the human work behind artificial intelligence, including creating examples and reviewing model responses. This role uses business operations experience to create fair, measurable tests that help evaluate how well AI systems handle real workplace tasks.