Litigation AI Evaluation Attorney

You will help train and evaluate legal AI systems through litigation-focused review. The work uses practical legal judgment to assess simulated disputes, legal analysis, persuasive arguments, case law, and procedural questions.

You will explain where AI responses fall short and how their legal reasoning can improve. You will also help create evaluation frameworks, grading criteria, guidelines, datasets, and best practices for AI-driven legal work.

• Spot legal issues in simulated litigation tasks.
• Review AI responses for accuracy, legal reasoning, clarity, and procedural fit.
• Assess argument construction, case strategy, motion practice, and legal analysis.
• Give precise, actionable feedback on weaknesses in AI-generated legal work.
• Create objective criteria for evaluating AI performance on legal tasks.
• Work with research and product teams on legal AI guidelines, datasets, and best practices.

This is a part-time contractor role. The work requires strong legal judgment and the ability to explain that judgment clearly to teams developing AI systems.

• Pay: $80 to $170 per hour.
• Open to candidates in the listed countries, including the United States.
• Fluent English is required.
• A J.D. from an ABA-accredited law school is required.
• Active admission to practice law in at least one U.S. jurisdiction is required.
• You must be actively practicing in litigation, corporate law, real estate, bankruptcy, or compliance.
• LL.M.-only and foreign-equivalent qualifications do not meet the stated education requirement.
• Strong legal research, writing, motion practice, case strategy, analytical, and communication skills are required.
• Seasoned litigation experience is strongly preferred.
• You should be able to turn legal judgment into precise feedback for AI systems and work with research and product teams.

The following experience can strengthen your application, although it is not listed as required.

• Judicial clerkship experience.
• Law school teaching or lecturing.
• Law journal or law review editorial experience.
• Experience with AI, legal technology, or training initiatives.

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

AI training work is the human side of building artificial intelligence. Experienced professionals review examples, assess model responses, and provide feedback so AI systems become more accurate and useful in specialized fields such as law.