The Work
You will help improve AI systems by creating difficult software engineering problems and reviewing the answers those systems produce. Your reviews will focus on technical accuracy, practical feasibility, and whether the advice reflects sound production engineering practices.
The work is remote, independent, and asynchronous, so you can complete project tasks at your own pace.
- Create software engineering problems and realistic scenarios based on system design, architecture, and implementation work.
- Evaluate AI-generated software engineering responses for technical accuracy and practical feasibility.
- Assess whether model responses reflect sound production engineering practices.
- Write clear, structured feedback that helps improve AI model performance.
What It Pays and Takes
This is a flexible, part-time, project-based contract role for software engineers who can explain complex technical ideas clearly and assess how engineering decisions work in practice.
- $120 per hour.
- 20 or more hours per week.
- Remote work open to candidates based in the United States.
- Professional fluency in English.
- At least one year of direct professional or research experience as a software engineer.
- Bachelor's degree in Computer Science or a related technical field.
- Strong depth in at least one area: backend systems and distributed architecture, infrastructure and cloud platforms, DevOps, or systems programming and performance engineering.
- Strong written communication, careful technical attention to detail, and the ability to work independently in a remote, asynchronous setting.
- Experience at a recognized, top-tier technology company may strengthen your background for this work.