The Work
You will evaluate AI products, models, and agents against predefined scenarios and project guidelines. The work focuses on checking accuracy, reasoning, responsiveness, and whether the system follows instructions.
You will complete repeatable tests, document findings in structured reports, and submit evaluation datasets through AI training platforms. Some projects may require you to reset usage limits and repeat evaluations under established procedures.
- Test AI models and agents using detailed scenarios and project standards.
- Check accuracy, reasoning, responsiveness, and instruction-following.
- Record observations, anomalies, and findings in structured written reports.
- Repeat evaluations when required by project protocols.
- Maintain consistent quality during high-volume evaluation work.
What It Pays And Takes
This is a remote, part-time contractor role. The position is open to candidates in India, Japan, and the United Kingdom.
- Pay: $14 to $36 per hour.
- Location: Remote work open to candidates in India, Japan, and the United Kingdom.
- Language: Fluency in English.
- Experience level: Entry level.
- Preferred background: Experience with AI products, AI models, AI agent evaluation, software quality assurance, digital product testing, or AI research.
- Follow complex instructions precisely and consistently.
- Pay close attention to detail and work comfortably on repetitive, high-volume tasks within strict timeframes.
- Familiarity with using AI tools in professional or personal activities is helpful.
How It Works
Apply on OpenTrain with your resume, then complete the application on the hiring site.