AI Training Data Quality Manager

You will lead quality strategy for AI training data and annotation programs. The work focuses on evaluation tasks where multiple chatbots are compared and given a final assessment.

You will oversee quality systems, support consistent delivery, and work with project leaders to balance quality, speed, and cost.

• Define quality standards, metrics, and targets across data types.
• Build and lead Quality Leads and QA teams.
• Design audit, sampling, calibration, and escalation frameworks.
• Lead quality reviews and manage quality-related escalations.
• Identify root causes and improve processes, training, and guidelines.
• Monitor quality reports and drive corrective actions.

This is a project-based contractor role involving a defined number of evaluation tasks. The engagement is planned for 16 weeks.

• Schedule: 20 or more hours per week.
• Working pattern: five working days per week, including weekends as required, with two weekdays off.
• Work hours: 7:00 a.m. to 4:00 p.m. Pacific Time.
• Location: Open worldwide.
• Language: Professional fluency in English.
• Experience: At least 8 years of professional experience, including 4 or more years leading teams.
• Strong quality management and high-volume operations experience.
• Experience designing and scaling quality systems.
• Experience leading managers or team leads.
• Excellent analytical, communication, and stakeholder-management skills.
• Preferred experience with annotation, data labeling, AI training data, multimodal work, or large language model evaluation.

OpenTrain is a platform where people find AI training and data-labeling roles, build a profile, and start applications. Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind systems that learn from examples, including comparing chatbot answers and rating model outputs. People with experience in quality management and specialized evaluation work help make these systems more accurate and consistent.