Senior Software Engineer Go LLM Evaluation Repo Validation

You will help create and review software engineering tasks used to evaluate language models. The work uses real open-source repositories and focuses on whether an AI system can understand, modify, test, and fix code.

You will work with researchers and lead junior engineers on related projects. You will also set up repositories locally so that code changes and test results can be checked in a reliable way.

• Analyze and sort GitHub issues from widely used open-source libraries.
• Set up code repositories, including Docker environments and basic software pipelines.
• Review unit test coverage and test quality.
• Run and modify codebases locally to assess AI performance on bug-fixing tasks.
• Work with researchers to find repositories and issues that challenge language models.
• Lead junior engineers working on related projects.

The role is a part-time contractor position with a commitment of at least 20 hours per week. It is open to candidates in the listed countries who can work in English.

• Pay: The listing does not provide a rate.
• Time: 20 or more hours per week.
• Location: Open to candidates in India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Türkiye, or Mexico.
• Language: English fluency.
• Experience: At least three years of overall software engineering experience.
• Technical skills: Strong Go programming experience, plus Git, Docker, and basic software pipeline setup.
• Work skills: Ability to understand complex codebases and run, modify, and test real-world projects locally.
• Helpful background: Experience with LLM research or evaluation, developer tools, automation agents, or related testing.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind systems that write and understand code, including reviewing model responses and testing whether generated code works. Software engineers are needed for this work because they can judge correctness, test results, and the practical quality of code changes.

OpenTrain helps people find AI training and data-labeling projects, build a profile, and apply in minutes. Creating an OpenTrain account is free.