Data Analyst (AI Evaluation)

Responsibilities

• Review datasets and detailed task outputs for accuracy, completeness, and adherence to provided guidelines.
• Identify and flag inconsistencies, errors, and outputs that deviate from specified instructions.
• Apply structured rubrics and evaluation criteria consistently across large datasets.
• Exercise sound judgment and document clear rationale when evaluating ambiguous scenarios or incomplete guidelines.
• Escalate recurring patterns and systemic data issues for further analysis rather than addressing them individually.
• Provide clear, actionable written and verbal feedback that identifies issues and suggests appropriate resolution paths.
• Maintain meticulous attention to detail while completing high-volume and repetitive data review assignments.

Skills

Requirements

• 3–5+ years of experience in data review, data quality, quality assurance, or analytical roles.
• Proven ability to review, validate, and critique data or deliverables against explicit criteria.
• Exceptional ability to follow detailed written instructions and apply complex evaluation rubrics precisely.
• Demonstrated comfort with ambiguity and making justifiable decisions when guidelines are incomplete.
• Advanced attention to detail and strong error-spotting capabilities across repetitive or high-volume work.
• Strong written and verbal communication skills for documenting findings and providing constructive feedback.
• Baseline fluency with spreadsheets, including sorting, filtering, and simple formulas.
• SQL or hands-on data querying experience is a plus.
• Experience with data annotation, labeling, or rubric-based evaluation is advantageous.

Benefits

• Remote contractor opportunity for US-based professionals.
• Compensation of $30–$60 per hour.
• Opportunity to contribute domain expertise to next-generation AI training and evaluation.
• No prior AI experience required.
• Work focused on real-world data quality, review, and evaluation.