Python ML Quality Assurance Team Lead

You will lead quality review for Python and machine learning training work. This includes checking AI-generated code, machine learning workflows, model explanations, and contributor QA work against project guidelines and rubrics.

• Review Python code, machine learning pipelines, preprocessing, model training workflows, evaluation logic, and explanations for correctness and reproducibility.
• Check for data leakage, statistical problems, debugging errors, formatting issues, readability, maintainability, and instruction-following.
• Identify flawed methods, incorrect metrics, made-up package interfaces, misleading conclusions, and incomplete explanations.
• Give clear written feedback, answer technical questions, and escalate recurring or serious quality issues.
• Update guidance, trackers, FAQs, examples, calibration tasks, and onboarding materials.
• Support onboarding and training calls for Python machine learning contributors.
• Help improve quality processes for remote technical teams.

This is an intermediate-level, part-time contractor role for candidates in the United States. The work requires strong Python and machine learning knowledge, along with clear English communication for technical feedback and team coordination.

• Pay: $120 per hour.
• Time: 20+ hours per week.
• Location: Open to candidates in the United States.
• Language: Strong English communication skills.
• Python: Strong knowledge of data structures, functions, classes, iterators, comprehensions, exception handling, virtual environments, package management, testing, and debugging.
• Machine learning: Strong knowledge of supervised and unsupervised learning, feature engineering, train/test splits, cross-validation, model selection, data leakage, regression, classification, clustering, metrics, bias and variance, regularization, and reproducibility.
• Review skills: Ability to assess machine learning content against detailed rubrics and explain technical problems clearly.
• Preferred background: AI training, data annotation, large language model evaluation, code QA, machine learning QA, or rubric-based technical review.
• Leadership: Experience leading or supporting remote teams of trainers, reviewers, engineers, data scientists, or machine learning researchers is preferred.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

OpenTrain is a platform where people find AI training work, build a profile, and start applications. AI training is the human work behind modern AI systems, including reviewing code and model outputs; people with strong technical experience are needed to judge whether those outputs are correct, useful, and reliable.