CONTRACTORRemote, US OnlyRemoteActive
Gmail & Google Calendar AI Assistant Evaluator
Evaluate next-generation AI assistants by completing realistic digital tasks involving Gmail, Google Calendar, bookings, scheduling, and coordination, then reviewing and grading assistant performance to improve model quality.
Salary
USD15 - USD30 / hour
Department
AI Assistant Evaluation
Experience
Hands-on daily experience using Gmail and Google Calendar for personal scheduling, communication, coordination, and online bookings, with practical experience using AI tools
Curated by Farooq77 Jobs
Role fit snapshot
- Engagement
- Remote contractor | micro1 application platform
- Experience
- Recorded experience: Hands-on daily experience using Gmail and Google Calendar for personal scheduling, communication, coordination, and online bookings, with practical experience using AI tools
- Core expertise
- AI Assistant Evaluation | Gmail | Google Calendar | AI Usage
- Geographic eligibility
- Not specified beyond Remote
- Listing dates
- Posted 2026-09-23 | Valid through 2026-10-23
- Compensation
- Recorded compensation: $15-$30/hour
Responsibilities
- Complete realistic everyday digital tasks involving email, scheduling, booking, and coordination using AI assistant tools.
- Provide clear instructions to AI assistants for real-world tasks and carefully verify their work for accuracy and completeness.
- Apply detailed grading guidelines to evaluate, rank, and annotate AI assistant responses and provide structured feedback.
- Test scenarios involving email threads, calendar invitations, online bookings, and multi-person coordination, including diverse situations and edge cases.
- Use AI training tools and platforms to record findings and submit evaluation data according to project standards and milestones.
- Collaborate with project trainers and contributors to resolve ambiguities, refine evaluation guidelines, and maintain consistency.
- Participate in ongoing quality reviews and incorporate feedback to maintain rigorous evaluation standards.
Skills
GmailGoogle CalendarAI UsageSchedulingEmail ManagementGoogle MeetingsOnline BookingAI Assistant EvaluationQuality EvaluationPrompt WritingAttention to DetailWritten CommunicationTime Management
Requirements
- Be based in the United States.
- Have an iPhone with iMessage.
- Have a Facebook or Instagram account.
- Use Gmail and Google Calendar daily for email communication, invitations, scheduling, and managing plans.
- Have regular experience coordinating with others through email or text.
- Be comfortable independently booking restaurants, appointments, travel, deliveries, or similar services online.
- Have experience using AI tools for practical tasks and be comfortable instructing AI assistants and reviewing their work.
- Demonstrate exceptional attention to detail and accuracy when evaluating AI-generated output.
- Have strong written communication skills for clear reporting and timely project updates.
- Demonstrate strong time management and self-organization for independent remote work.
Benefits
- Remote contractor opportunity for US-based contributors.
- Compensation of $15–$30 per hour.
- Opportunity to evaluate AI assistants on realistic everyday digital tasks.
- Opportunity to contribute real-world feedback to the improvement of next-generation AI assistants.
- No prior AI evaluation experience required.
Before you apply
- Confirm that your location is eligible for the role.
- Confirm the employment or contract type.
- Verify the current compensation at the official source.
- Review the required skills and experience.
- Check that the listing is still open before applying.
- Never pay a fee to submit a job application.