The work
You will help evaluate how well large language models understand psychology. The work combines prompt writing, psychology research with AI tools, and careful review of model responses.
You will use your psychology knowledge to judge whether explanations are accurate, clear, and relevant to specialized topics.
- Write prompts that test psychology concepts and specialized subject areas.
- Evaluate AI-generated responses for quality and accuracy.
- Research psychology topics with assistance from AI tools.
- Complete tasks that test scientific and language understanding.
- Apply research expertise and disciplinary judgment when comparing model responses with accurate psychology knowledge.
What it pays and takes
This is remote, asynchronous contract work with flexible participation based on available assignments. The role is intended for people who can work independently and contribute at least 20 hours per week.
- Pay: up to $55 per hour.
- Hours: 20+ hours per week.
- Location: open to candidates in the United States.
- Language: professional fluency in English.
- Education: master's degree from a US institution.
- Advanced knowledge of psychology and the ability to explain important concepts clearly.
- Disciplinary or research expertise in a specialized psychology area.
- Strong judgment when assessing AI-generated responses.
- Ability to work independently in an asynchronous setting.
- Experience with domain-specific prompts, AI response evaluation, or psychology research is helpful.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.