The work
As a Benefits Counselor AI Evaluator, you will help improve AI systems that answer questions about government services. You will use your experience assisting the public to judge whether questions sound realistic and whether Spanish answers are accurate, clear, complete, and useful.
The duties and qualifications for this Benefits Counselor role should be reviewed before applying.
- Review sample questions written in Spanish and English.
- Identify questions that do not reflect realistic public needs.
- Create rubrics that define correct and complete answers for government services.
- Evaluate AI-generated Spanish answers against those rubrics.
- Find factual errors, missing information, mistranslations, unclear wording, and unnatural language.
- Write clear feedback asynchronously.
What it pays and takes
This is a short-term, remote contractor project with more availability expected toward the end of the project. The work is open to candidates in the United States.
- $35 to $50 per hour.
- Part-time commitment of 10 to 20 hours per week.
- Professional fluency in Spanish and English, with precise writing in both languages.
- At least one year of experience counseling or assisting the public in a relevant government services area.
- Practical expertise in at least one of Medicare, passports, veterans benefits, student loans or financial aid, or National Park services.
- Ability to tell accurate, complete public-service guidance from misleading, incomplete, or linguistically unnatural answers.
- Experience across several government services areas, professional interpretation or translation, Spanish-language guides or FAQs, or work with rural and low-literacy communities can be useful.