DoD Staff Writing AI Evaluation Specialist

You will help evaluate how well AI systems create Department of Defense staff-writing materials. The work uses your experience with federal reporting to build realistic examples, review generated text, and give precise feedback.

You will work with recurring operational and administrative reporting formats, including weekly, monthly, and ad hoc materials.

• Create prompts, source materials, and reference answers for DoD staff-writing tasks.
• Write authentic Weekly Activity Reports, Situation Reports, executive summaries, performance reports, and related documents.
• Create grading guidelines and rubrics for checking AI-generated reports for accuracy, tone, structure, compliance, and audience fit.
• Design and review test materials for summarization and reporting capabilities.
• Refine prompts, responses, and evaluation criteria through feedback cycles and reviews of model performance.

This is a remote, part-time contractor role for professionals based in the United States. Prior AI training experience is not required, but strong DoD staff-writing and reporting experience is required.

• $40 to $80 per hour.
• Remote work open to candidates in the United States.
• At least three years of relevant experience as a uniformed service member, DoD civilian employee, or supporting contractor.
• Direct experience preparing recurring reports or executive updates for senior leadership.
• Familiarity with WARs, SITREPs, executive summaries, performance reports, or comparable DoD documents.
• Strong written and verbal communication, analytical judgment, and attention to detail.
• Working knowledge of federal compliance, DoD terminology, and reporting workflows.
• Experience with PowerPoint briefings, memos, Excel summaries, and related back-office documents.
• Experience across multiple military roles, units, services, or DoD organizations is helpful.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training is the human work behind systems that generate and evaluate text. Contributors create examples, rate model responses, and explain what good writing should look like, while experienced professionals help models perform accurately in specialized settings.