About this role
About Turing: Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.
Role Overview
We are looking for a detail-oriented QA Analyst to evaluate and compare responses generated by multiple chatbots. The role involves reviewing outputs against defined guidelines, identifying inaccuracies or quality issues, and providing a clear final assessment for each evaluation task.
Key Responsibilities
- Evaluate and compare responses generated by multiple chatbots.
- Assess responses for accuracy, relevance, completeness, clarity, and adherence to guidelines.
- Identify errors, inconsistencies, missing information, and potential quality issues.
- Provide structured feedback and final assessments for each task.
- Follow evaluation guidelines and maintain consistency across all reviews.
- Document findings clearly and accurately.
- Collaborate with project and quality teams to resolve queries.
- Meet assigned productivity, quality, and turnaround-time targets.
- Escalate complex or ambiguous cases when necessary.
Required Qualifications
- Experience in Quality Assurance, data annotation, content evaluation, testing, or a similar role.
- Strong analytical, critical-thinking, and problem-solving skills.
- Excellent written and verbal communication skills.
- High attention to detail and ability to identify subtle errors.
- Comfortable working with AI tools, chatbots, and online platforms.
- Prior experience with chatbot evaluation, LLM testing, or data-quality projects is an advantage.