Research Evaluation Specialist (PhD / Researcher / Professor)

Responsibilities

• Create original, high-difficulty question-and-answer pairs at the cutting edge of the contributor's discipline to rigorously assess AI model capabilities.
• Source, verify, and thoroughly document answers using primary sources and authoritative references with clear citations and reasoning.
• Design questions requiring advanced reasoning, methodological nuance, or synthesis across multiple sources.
• Ensure questions are resistant to oversimplified, superficial, or shortcut solutions.
• Test questions against AI systems and identify items that are not sufficiently challenging.
• Iteratively increase question complexity while preserving accuracy and methodological soundness.
• Write questions and answers with high precision and clarity while eliminating ambiguity.
• Integrate reviewer feedback and consistently maintain project guidelines and quality standards.

Skills

Requirements

• Completed PhD, active PhD candidacy, or equivalent research experience as a specialist, researcher, or professor in a relevant domain.
• Demonstrated track record of scholarly research and in-depth subject matter expertise.
• Strong familiarity with primary literature and authoritative academic sources.
• Exceptional analytical thinking and close attention to detail.
• Strong written communication skills in English.
• Experience sourcing, verifying, and triangulating information from authoritative references.
• Ability to work independently and reliably in a remote engagement.
• Ability to compose challenging, original, and methodologically sound questions.
• Ability to meet minimum weekly task submission requirements.
• Experience with AI training or model evaluation is advantageous but not required.
• No prior experience in AI is required.

Benefits

• Fully remote contractor opportunity.
• Compensation equivalent to $40–$90 per hour based on qualifying output.
• Opportunity to apply advanced research expertise to next-generation AI model evaluation.
• Research-intensive work involving primary literature, source triangulation, methodological reasoning, and high-difficulty question design.
• Opportunity to contribute within the expert's own academic or research discipline.
• Selected experts may begin their first tasks within 24–48 hours after completing onboarding.
• No prior AI experience required.