The work
You will create and refine code datasets used to train and benchmark large language models. The work focuses on Python across backend services, data pipelines, and machine learning infrastructure, with additional code in JavaScript, ReactJS, C/C++, Java, Rust, and Go.
You will review AI-generated code and explain whether it meets standards for efficiency, scalability, reliability, and software engineering performance. You will also build Python agents and automated checks that find error patterns and verify software solutions.
- Curate code examples and create precise solutions for AI model training.
- Correct implementations and improve AI-generated code.
- Assess software across prototyping, architecture, API design, production implementation, experimentation, monitoring, and operational maintenance.
- Collaborate with cross-functional teams to improve AI coding solutions against industry benchmarks.
What it pays and takes
This is a contractor engagement planned for one month, with possible extensions based on performance and fit. No pay rate is provided in the listing.
- Location: Open to candidates based in the United States.
- Time commitment: 20 or more hours per week.
- Experience: At least three years of software engineering experience.
- Technical skills: Strong Python expertise, including production frameworks, tools, and development practices.
- Software background: Experience building full-stack applications and deploying scalable software with modern languages and tools.
- Knowledge: Software architecture, design, development, debugging, and code-quality assessment.
- Communication: Ability to clearly explain technical evaluation decisions in writing and conversation.
- Language: Fluent in English.