About this role
About Turing: Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
Role Overview
We are seeking US-based generalist raters to participate in Gemini Personalization Evals. In this role, raters will perform generalist evaluation work using personalized prompts designed to retrieve context and data across connected Google apps.
Key Qualifications
- Location: Must be currently based in the United States.
- App Connectivity: Must be willing and able to connect their Google apps (e.g., Gmail, Google Photos, Google Calendar, Google Drive, etc.) to Gemini to support data retrieval and personalized prompt evaluations.
- Role Scope: Perform generalist rating and evaluation tasks, assessing model performance, context retrieval, and response quality across connected apps.
- Account Activity: Active use of standard Google workspace/consumer apps with sufficient personal data/history to generate and evaluate retrieval prompts.
- Exceptional Analytical Thinking: Ability to evaluate nuanced AI responses and identify strengths and weaknesses in personalization quality.
- Attention to Detail: Strong ability to review AI-generated responses and identify subtle issues or inconsistencies.
- Communication: Excellent written communication skills for providing clear and structured evaluation feedback.