Key details
- Role type
- Contract
- Compensation
- $30–$50/hr
- Work arrangement
- Remote
- Category
- science
- Openings
- 10
About this role
Role Overview
Apply social science research expertise to create high-quality evaluation materials that help train and benchmark next-generation AI systems. This remote contract role centers on realistic, advanced research scenarios and requires methodological rigor, strong source synthesis, and precise rubric development. No prior AI experience is required.
Key Responsibilities
- Design and author complex evaluation tasks based on real-world research work, including survey analysis, qualitative coding, literature reviews, and statistical analysis.
- Create and synthesize realistic research artifacts, such as survey instruments, coded datasets, statistical outputs, and source documents.
- Select sound methodological approaches and provide clear, defensible interpretations consistent with social science best practices.
- Develop comprehensive grading rubrics with 35 or more items that assess methodological choices, execution fidelity, and interpretation quality.
- Ensure tasks reflect the nuance and complexity of day-to-day advanced research rather than simplified textbook exercises.
- Collaborate asynchronously with project leads and reviewers to refine tasks, data, and evaluation frameworks.
- Maintain rigorous, detailed, transparent, and reproducible standards across all deliverables.
Qualifications
- Bachelor''s or Master''s degree in sociology, economics, psychology, political science, or a related social science field.
- At least 2 years of hands-on experience designing survey instruments, coding qualitative data, conducting literature reviews, and using statistical software such as SPSS, R, or Stata.
- Demonstrated ability to synthesize varied research sources and build well-documented data artifacts.
- Strong methodological rigor, research mastery, source synthesis skills, and commitment to accurate, reproducible work.
- Experience creating or applying detailed grading rubrics or evaluation guidelines.
- Comfort completing detailed, methodical research assignments involving multiple data types and sources.
- Proficient written English for technical research content and evaluation materials.
Work Terms
- Remote contract engagement.
- Compensation is output-based and paid for each task that meets project specifications; completion time varies by experience and workflow.
- Minimum submission requirements apply, including a required minimum number of tasks each week.
- Selected candidates should be ready to begin initial tasks within 24 to 48 hours after completing the required onboarding steps.
Compensation
$30 to $50 per hour.