Intelligence Operations AI Evaluation Expert

You will evaluate AI-generated scenarios and related materials about intelligence operations and security policy. Your reviews will help improve how AI reasons about collection, operational planning, and intelligence decision-making.

• Judge whether generated content is accurate, realistic, relevant, and consistent with real-world intelligence practice.
• Evaluate intelligence collection methods and operational processes.
• Review and refine intelligence case studies, analytical summaries, and scenario-based materials.
• Identify gaps, errors, and unrealistic assumptions in AI-generated content.
• Provide structured feedback that improves AI reasoning about intelligence operations.

This is a part-time contractor role. The listing does not provide pay details or a set number of hours.

• Pay: Not specified.
• Work type: Part-time contract.
• Experience level: Entry level.
• Professional background: Current or previous experience with a civilian intelligence agency or an equivalent organization.
• Required expertise: Intelligence operations, collection, or collection management.
• Relevant knowledge: HUMINT, SIGINT, OSINT, or another intelligence collection discipline; agency procedures; operational frameworks; legal authorities; and interagency coordination.
• Helpful experience: Operational planning, intelligence collection requirements, or evaluating intelligence information.
• Skills: Strong analytical judgment, careful attention to detail, and clear written communication.
• Language: Professional fluency in English.
• Location: Open to candidates in AE, AR, AT, BD, BE, BH, BR, CA, CH, CL, CO, DE, DK, DZ, EG, ES, FR, GB, GH, GR, ID, IN, IT, JO, JP, KE, KG.
• Location: Also open to candidates in KW, KZ, LB, LK, MA, MX, MY, NG, NL, OM, PE, PH, PK, PS, PT, QA, SA, SG, TH, TN, TW, US, UZ, VN, and ZA.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training work uses human judgment to review examples and model responses so AI systems can improve. People with specialist knowledge are needed when the work depends on accurate professional practice, such as intelligence operations and collection.