SWE Bench Data Engineer and Data Scientist

You will help design and validate data pipelines and evaluation tasks used to benchmark AI systems. The work involves production-like datasets, Python code, data workflows, and checks for accuracy and reproducibility.

• Work with structured and unstructured datasets for SWE Bench-style evaluation tasks.
• Design, build, and validate data pipelines for benchmarking and evaluation workflows.
• Process and analyze data, prepare features, and validate data science workflows.
• Write, run, and modify Python code locally to process data and support experiments.
• Check data quality, transformations, and outputs for correctness and reproducibility.
• Create clean, documented, reusable workflows for benchmarking.
• Take part in code reviews focused on code quality and maintainability.
• Work with researchers and engineers to design realistic data engineering and data science tasks for AI systems.

The listing does not provide a pay rate. This is a three-month contractor engagement, with the contract length adjustable based on engagement.

• Schedule: At least 4 hours per day and a minimum of 20 hours per week.
• Time overlap: At least 4 hours of overlap with Pacific Standard Time.
• Location: Open to candidates in India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Türkiye, Brazil, and Mexico.
• Language: Excellent spoken and written English.
• Experience: At least 3 years as a Data Engineer, Data Scientist, or data-focused Software Engineer.
• Technical skills: Strong Python skills for data engineering and data science workflows.
• Background: Experience with data processing, analysis, model-related workflows, and structured and unstructured data.
• Code skills: Ability to understand and modify complex codebases and write readable, reusable, maintainable, documented code.
• Problem solving: Experience with algorithmic or data-intensive problems.
• Helpful background: SWE Bench or similar benchmark-based evaluation work, or experience designing AI model evaluation tasks.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind systems that learn from examples, including building datasets, reviewing outputs, and evaluating code and model performance. OpenTrain is a free platform where people find AI training and data-labeling projects, build a profile, and start applications.