About this role
Role Type: Contractor
Location: Anywhere in the world, remote
Opportunity Snapshot
Pay: $50–100/hour
Time per task: ~15 hours per run
Onboarding: As soon as you’re selected, Talent Ops will send you everything you need to get started
You’ll need: clear open source contributions and a profile to showcase them, such as GitHub (preferably with C++, Python, Java, Go, TypeScript, or Rust). If you don’t, you’ll be assessed through a HackerRank assessment instead.
Your tasks: Build reproducible Reinforcement Learning Environments that test an AI model’s ability to fix code, add features, refactor, and optimize performance - including a golden reference solution for each problem
Bonus: experts who complete the AI interview for this specific role move through the process significantly faster.
We care about your human judgment: our interview and assessment stages are designed to see how you think, so we ask that you complete them on your own, without AI assistants or help from others.
Job Description
In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
You'll create realistic, interesting and challenging coding tasks for AI to solve involving feature implementation and bug fixes, and implement deterministic verifiers that accept reasonable valid solutions and reject everything else.