About this role
Role Type: Contractor, Remote
Location: United States only
micro1 is engaging Gmail & Google Calendar AI Assistant Evaluators to collaborate on a customer-driven project enhancing AI assistant quality through real-world task evaluation. In this role, you'll use your everyday experience managing your digital life — email, calendars, bookings, and coordination — to help train and evaluate next-generation AI assistants. Your work will shape how AI models handle the real tasks people delegate every day.
Key Responsibilities
- Complete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized, repeatable conditions.
- Give an AI assistant clear instructions for real-world tasks, then carefully review and verify its work for accuracy and completeness.
- Apply detailed grading guidelines to evaluate, rank, and annotate assistant responses, providing structured feedback that improves model performance.
- Test scenarios involving email threads, calendar invites, online bookings, and multi-person coordination, ensuring coverage of diverse situations and edge cases.
- Utilize AI training tools and platforms to record findings and submit evaluation data in alignment with project standards and milestones.
- Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
- Participate in ongoing quality reviews, incorporating feedback to maintain rigorous evaluation standards.
Required Skills and Qualifications
- Are based in the US, have an iPhone with iMessage, and have a Facebook or Instagram account.