The Work
You will test two AI agents side by side from a smartphone while they handle realistic everyday tasks. You will use personal accounts, document each attempt, and give structured feedback on how well the agents work from a user's point of view.
Each run includes evidence collection and scoring. You will follow detailed instructions, record each step accurately, and approve or stop an agent when an important action requires user control.
- Test tasks such as paying bills, processing returns, sending follow-up emails, making bookings, shopping, managing groceries, planning travel, coordinating family logistics, attending outings, and completing forms.
- Screen record every attempt from a smartphone.
- Score completion, quality, control issues, satisfaction, and time.
- Write clear observations about what worked, what failed, and how the experience felt.
What It Pays and Takes
This is an entry-level contractor role with part-time work. Generalists are welcome, and no coding background or previous AI industry experience is required.
- Pay: $25 to $45 per hour.
- Time: Each run takes approximately 1.5 hours, including evidence collection and scoring.
- Schedule: Flexible schedule with remote work completed from a smartphone.
- Location: Open to candidates based in the United States.
- Education: Bachelor's degree required.
- Experience: Two to three years of relevant experience requested.
- Skills: Regular use of AI tools in daily life, strong attention to detail, reliable instruction-following, clear written communication, and organized documentation.
- Equipment and accounts: Smartphone screen-recording capability and active personal AI accounts that can be used on a phone.
- Helpful background: Engineering, business management, office operations, digital workflows, or another area related to everyday errands.