CONTRACTORRemote, Northern America and EuropeRemoteActive
Senior AI Trainer
Collaborate on a customer-driven project focused on improving AI system quality through expert-level model training and evaluation. Apply generalist expertise and hands-on experience with AI products to evaluate model performance, annotate responses, develop and stress-test prompts, and contribute high-quality evaluation datasets for next-generation AI systems.
Salary
USD14 - USD36 / hour
Department
AI Training & Model Evaluation
Experience
Experience with AI model training, evaluation, data labeling, RLHF, or similar data-centric AI projects
Curated by Farooq77 Jobs
Role fit snapshot
- Engagement
- Remote contractor | micro1 application platform
- Experience
- Recorded experience: Experience with AI model training, evaluation, data labeling, RLHF, or similar data-centric AI projects
- Core expertise
- AI Training & Model Evaluation | AI Model Evaluation | Video Annotation | Data Labeling
- Geographic eligibility
- Not specified beyond Remote
- Listing dates
- Posted 2026-09-23 | Valid through 2026-10-23
- Compensation
- Recorded compensation: $14-$36/hour
Responsibilities
- Evaluate the performance of AI chat and search tools under standardized and repeatable conditions.
- Apply detailed grading guidelines to evaluate, rank, and annotate model responses and provide structured feedback.
- Write, refine, and stress-test prompts covering diverse scenarios, edge cases, and user intents.
- Verify consistency and accuracy across evaluations and correct discrepancies between ratings and evaluation rubrics.
- Use AI training tools and platforms to record findings and submit evaluation datasets according to project standards and milestones.
- Collaborate with project trainers and contributors to resolve ambiguities and refine evaluation guidelines.
- Participate in ongoing quality reviews and incorporate feedback to maintain rigorous training and annotation standards.
Skills
AI Model EvaluationVideo AnnotationData LabelingAI TrainingEvaluation RubricsPrompt EngineeringAI Response EvaluationHuman DataData AnnotationAI Training ToolsModel Behavior AnalysisQuality AssuranceAttention to DetailTime ManagementWritten CommunicationVerbal Communication
Requirements
- Exceptional attention to detail and accuracy when reviewing and evaluating AI-generated content.
- Strong written and verbal communication skills for collaboration, reporting, and timely project updates.
- Strong time management and self-organization skills for independent remote work.
- Analytical and problem-solving mindset with a proactive approach to resolving evaluation challenges.
- Experience with AI model training, RLHF, data labeling, or similar data-centric evaluation projects is preferred.
- Familiarity with AI products, prompt engineering, and model behaviors and limitations is preferred.
- Experience writing evaluation rubrics, grading model outputs, or reviewing AI responses for accuracy, helpfulness, and safety is preferred.
- Background in AI training, machine learning data preparation, or LLM-focused projects is strongly preferred.
Benefits
- Remote contractor opportunity across Northern America and Europe.
- Compensation of $14–$36 per hour.
- Opportunity to contribute to next-generation AI training and evaluation.
- Opportunity to work with AI products, model evaluation, prompt engineering, and evaluation datasets.
- Opportunity to contribute to customer-driven AI quality improvement projects.
Before you apply
- Confirm that your location is eligible for the role.
- Confirm the employment or contract type.
- Verify the current compensation at the official source.
- Review the required skills and experience.
- Check that the listing is still open before applying.
- Never pay a fee to submit a job application.