About this role
About Turing: Turing’s mission is to accelerate superintelligence to drive real economic progress. Headquartered in San Francisco, Turing works with frontier AI labs to generate high-quality data, evaluations, and reinforcement learning environments that improve model capabilities in coding, reasoning, tool use, and multimodality. In coding, Turing is the largest and longest-running data provider in the category.
Role Overview
The Business Analyst works on a Computer-Using Agent (CUA) evaluation project designed to assess and improve how AI systems understand instructions, analyze information, reason through problems, and complete tasks in digital environments. The role involves reviewing AI-generated responses and actions, validating information through online research, assessing accuracy and task completion, identifying errors or gaps, and providing detailed annotations, ratings, and explanations
Job Responsibilities
- Analyze, summarize, and structure complex written content clearly and accurately.
- Conduct online research to verify claims, sources, and supporting evidence.
- Solve analytical, logical reasoning, data interpretation, arithmetic, and puzzle-based questions.
- Create scenarios and questions to evaluate and improve large language model performance.
- Review AI-generated responses and provide detailed ratings, annotations, explanations, and feedback.
Job Requirements
- Demonstrate excellent English communication and reading comprehension skills.