The Work
You will own web scraping and data extraction workflows from start to finish. The work includes collecting information from complex, dynamic websites and delivering clean, accurate datasets.
You will work in a hybrid AI and human setup. AI agents handle repetitive steps, while you troubleshoot failures, check results, make decisions, and document unusual cases.
- Scrape multi-level websites, such as category, entity, and detail pages.
- Extract data from JavaScript-rendered pages, infinite scroll, AJAX content, and other dynamic site features.
- Use Python scripts and tools such as Apify and OpenRouter.
- Build resilient workflows with selectors, fallbacks, retries, batching, or parallel processing.
- Clean, normalize, and validate data before delivery.
- Deliver structured datasets in CSV, JSON, or Google Sheets.
- Use LLMs and other AI tools to speed up prompting, automation, and extraction tasks.
- Evaluate outputs, enforce formatting requirements, and identify scraping edge cases.
What It Pays And Takes
This is a part-time contractor role for an intermediate-level specialist. You must be able to follow detailed specifications, explain edge cases clearly, and maintain accurate data outputs.
- Pay: $20 USD per hour.
- Time: 20 or more hours per week.
- Location: Global. Applicants may work from any location.
- Language: Fluent English is required; the role description specifies B2 or higher.
- Experience: At least one year in web scraping, data engineering, software development, automation, or data analysis.
- Strong Python web scraping skills, including BeautifulSoup and Selenium, Playwright, or equivalent tools.
- Experience working with dynamic or JavaScript-heavy sites and changing site structures.
- Experience extracting data from hierarchical or multi-level website structures.
- Experience cleaning, normalizing, validating, and delivering structured data.
- Familiarity with LLMs or AI tools for workflow acceleration.
How It Works
Apply on OpenTrain. The employer reviews applications there.
About AI Training Work
OpenTrain AI is the hiring and contracting organization for this role. AI training work uses human judgment to prepare, review, and evaluate data that helps artificial intelligence systems perform better, so experienced contributors are paid for accurate technical work.