Psychology Research Expert

Create realistic behavioral science scenarios that test how AI models judge research, from study design through interpretation. Write reference answers that explain the methodological reasoning behind sound conclusions.

• Assess model responses for construct validity, quality of inference, awareness of replication, and appropriate use of evidence.
• Weigh constructs, confounds, effect sizes, and methodological limits.
• Identify plausible-sounding claims that go beyond what the evidence supports and explain research methods clearly.

• Work arrangement: Fully remote, asynchronous contractor work; the engagement is ongoing.
• Time commitment: At least 10 hours per week, with no maximum. Workload can increase or decrease from week to week.
• Location: Open to candidates in the countries listed as eligible for this role.
• Education and experience: An advanced degree in psychology or a closely related behavioral science, plus at least two years of research experience with human subjects or behavioral data.
• Skills: Working knowledge of study design, measurement, and statistical inference; strong written English; and the ability to explain methodological judgments clearly.
• Relevant backgrounds include academic research, UX research, and applied behavioral science.

Apply on OpenTrain with your resume, then complete the application on the hiring site.

AI training uses examples and judgments created by people to teach and evaluate AI systems. OpenTrain is a platform where people can find AI training and data-labeling opportunities and apply.