211 Specialist, Government Services AI Evaluator

You will help improve AI systems that answer questions about government services and community resources. Your work will draw on your experience as a 211 Specialist, Information and Referral Specialist, or Benefits Navigator.

You will judge whether questions sound like real requests from people seeking help, then assess whether AI answers are accurate, complete, current, and useful. The work is done asynchronously and includes writing clear feedback.

• Review sample questions and identify requests that do not reflect realistic caller needs.
• Write rubrics that define correct answers, suitable referrals, and useful next steps.
• Evaluate AI-generated answers against those rubrics.
• Identify errors, missing information, outdated guidance, and unhelpful responses.
• Give precise written feedback based on public-service accuracy and caller usefulness.

This is a part-time contract role for someone with practical experience answering public questions about government services, benefits, and community resources.

• Pay: $30 to $40 per hour.
• Location: Open to candidates currently residing in the United States.
• Experience: At least one year of regular, high-volume public contact through phone, chat, or in-person service.
• Required background: Experience as a 211 Specialist, Information and Referral Specialist, or Benefits Navigator.
• Required knowledge: Working knowledge of public benefits and community resources.
• Required skills: Clear, precise writing and the ability to judge whether guidance is complete and actionable.
• Helpful experience: Crisis intervention, needs assessment, community resource databases, guides, scripts, or training materials.
• Helpful experience: Service to rural or Spanish-speaking communities.

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 4 screening questions.

AI training is the human work behind systems that answer questions and generate content. Experienced public-service professionals help by reviewing examples, setting standards, and showing AI how accurate, complete, and useful guidance should look.