Medical Student, Resident, or Physician for AI Evaluation

Role Overview

Apply clinical expertise to help train and evaluate next-generation AI systems. You will create rigorous medical assessments that test nuanced reasoning, clinical accuracy, and reliability. Prior AI experience is not required.

Key Responsibilities

• Create original, high-difficulty medical question-and-answer pairs covering diagnosis, mechanisms, pharmacology, guidelines, and clinical judgment.
• Research and verify answers using primary literature, clinical guidelines, and authoritative references, documenting rationale and citations.
• Develop questions that require synthesis and clinical reasoning rather than simple fact recall.
• Evaluate AI responses, refine questions that are too straightforward, and increase complexity while maintaining clinical accuracy.
• Write clear, precise, defensible questions and answers that avoid ambiguity.
• Incorporate reviewer feedback and follow evolving project standards.

Qualifications

• Current medical student, resident, physician, or professional with equivalent biomedical expertise.
• Strong research, source-triangulation, analytical-thinking, and written-precision skills.
• Ability to locate, interpret, and synthesize primary literature and clinical guidelines.
• Exceptional attention to detail and strong written English skills. Native fluency is not required.
• Reliable and self-directed when working independently in a remote setting.
• Experience writing medical questions, conducting peer review, or completing evaluative work is an advantage.
• Familiarity with AI, machine learning, or model evaluation is helpful but not required.

Work Terms

• Remote contract engagement.
• Compensation is output-based and paid per task that meets project specifications. Completion time may vary by experience and workflow.
• Minimum submission requirements apply, including a minimum number of tasks submitted each week.
• Selected contributors should be ready to begin their first tasks within 24 to 48 hours after completing onboarding.

Compensation

Listed compensation range: $40 to $90 per hour.