Medical Evaluation Specialist (Students, Residents, Physicians)

Responsibilities

• Craft original, high-difficulty medical question-and-answer pairs covering diagnosis, mechanisms, pharmacology, guidelines, and clinical judgment.
• Source and verify answers using primary literature, clinical guidelines, and authoritative references, documenting rationale and citations.
• Develop questions requiring synthesis and genuine clinical reasoning rather than simple factual recall.
• Evaluate AI model responses, refine questions that are too straightforward, and increase complexity while maintaining clinical accuracy.
• Ensure questions and answers are clear, precise, defensible, and free from unnecessary ambiguity.
• Incorporate reviewer feedback and keep deliverables aligned with evolving project guidelines and quality standards.

Skills

Requirements

• Current medical training or clinical practice as a medical student, resident, or physician, or equivalent biomedical expertise.
• Demonstrated ability to locate, interpret, and synthesize information from primary literature and clinical guidelines.
• Exceptional attention to detail and strong written English proficiency; native fluency is not required.
• Ability to create well-structured, challenging, and clinically nuanced medical questions.
• Strong self-direction and reliability when managing independent remote contributions.
• Experience with medical question writing, peer review, or evaluation projects is advantageous.
• Familiarity with AI or machine learning systems and model evaluation is helpful but not required.

Benefits

• Fully remote contractor opportunity.
• Open to medical students, residents, physicians, and candidates with equivalent biomedical expertise.
• Opportunity to contribute clinical expertise to frontier AI evaluation and training.
• No prior AI experience required.
• Fast onboarding, with selected contributors generally expected to begin within 24–48 hours after onboarding.