Federal IT Specialist (AI Evaluation)

You will review AI-generated materials used in federal IT operations and judge whether they are accurate, complete, secure, and aligned with federal requirements. You will also assess how well AI systems handle realistic IT and security scenarios.

Your feedback will help improve AI systems used for federal IT work. The role combines documentation review with technical evaluation of systems, incidents, configurations, and security controls.

• Review authorization to operate packages, IT investment business cases, incident reports, privacy impact assessments, technical guidance, and related federal IT documents.
• Diagnose complex hardware, software, network, and application incidents represented in AI-generated scenarios.
• Evaluate technical documentation, system configurations, and security controls for accuracy and alignment with federal requirements.
• Provide clear feedback to improve AI model performance in federal IT use cases.
• Support incident-response simulations and assess whether AI systems detect and address security incidents appropriately.

This is a remote, part-time contractor role.

• Pay: $80 to $105 per hour.
• Work arrangement: Remote, part-time contract work.
• Language: Fluency in English.
• Location: Open to candidates in the United Arab Emirates, Argentina, Austria, Bangladesh, Belgium, Bahrain, Brazil, Canada, Switzerland, Chile, Colombia, Germany, Denmark, Algeria, Egypt, Spain, France, the United Kingdom, Ghana, Greece, Indonesia, India, Italy, Jordan, Japan, Kenya, Kyrgyzstan, Kuwait, Kazakhstan, Lebanon, Sri Lanka, Morocco, Mexico, Malaysia, Nigeria, the Netherlands, Oman, Peru, the Philippines, Pakistan, the Palestinian territories, Portugal, Qatar, Saudi Arabia, Singapore, Thailand, Tunisia, Taiwan, the United States, Uzbekistan, Vietnam, and South Africa.
• Experience: At least five years of federal IT experience in GS-2210 or an equivalent role.
• Technical background: Hands-on experience with hardware repair, network administration, incident response, and varied IT environments.
• Security and documentation: Experience implementing or assessing information security controls under federal frameworks such as FISMA and NIST.
• Federal materials: Experience preparing or reviewing authorization to operate packages, privacy impact assessments, incident reports, or IT investment business cases.
• Judgment: Strong judgment about data integrity, security, privacy, and information assurance.
• Helpful experience: Federal information technology management, systems administration, cybersecurity, software development, telecommunications, computer engineering, or computer science.

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 6 screening questions.

AI training is the human work behind systems that learn from examples, including reviewing documents, rating model responses, and testing whether AI follows technical requirements. People with specialized experience are needed to judge accuracy and risk in fields such as federal IT, security, and incident response. OpenTrain helps people find these roles, build a profile, and apply in one place.

Creating an OpenTrain account is free, and OpenTrain is not the employer or payer for this role.