Gmail & Google Calendar AI Assistant Evaluator
micro1 • Remote
Education
Not stated
Type
Hourly
Pay
$15-30/hr
Your rate depends on your experience and the task.
Actively hiring
50 openings
Checked
Only apply if this role fits your skills and interests.
About this role
From the micro1 listing
Role Title: Gmail & Google Calendar AI Assistant Evaluator Role Type: Contractor, Remote Location: United States only micro1 is engaging Gmail & Google Calendar AI Assistant Evaluators to collaborate on a customer-driven project enhancing AI assistant quality through real-world task evaluation. In this role, you'll use your everyday experience managing your digital life — email, calendars, bookings, and coordination — to help train and evaluate next-generation AI assistants. Your work will shape how AI models handle the real tasks people delegate every day.
Key Responsibilities
- Complete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized, repeatable conditions.
- Give an AI assistant clear instructions for real-world tasks, then carefully review and verify its work for accuracy and completeness.
- Apply detailed grading guidelines to evaluate, rank, and annotate assistant responses, providing structured feedback that improves model performance.
- Test scenarios involving email threads, calendar invites, online bookings, and multi-person coordination, ensuring coverage of diverse situations and edge cases.
- Utilize AI training tools and platforms to record findings and submit evaluation data in alignment with project standards and milestones.
- Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
- Participate in ongoing quality reviews, incorporating feedback to maintain rigorous evaluation standards.
Required Skills and Qualifications
- Are based in the US, have an iPhone with iMessage, and have a Facebook or Instagram account.
- Daily, hands-on use of Gmail and Google Calendar to run your own life: sending emails, accepting invites, scheduling, and rearranging plans.
- Regular experience coordinating with others over email or text — setting up meetups, following up on threads, or confirming shared plans and payments.
- Comfort booking things online independently, such as restaurants, appointments, travel, or deliveries.
- Experience using AI tools for real, practical tasks, with comfort giving an AI assistant instructions and checking its work.
- Exceptional attention to detail and accuracy when reviewing AI-generated output.
- Strong written communication skills for clear reporting and timely updates on progress and challenges.
- Demonstrated time management and self-organization for independent, remote project participation.
Preferred Qualifications
- Prior experience with AI evaluation, data labeling, user testing, or similar feedback-driven projects.
- Familiarity with prompt writing and a practical understanding of AI assistant behaviors and limitations.
- Experience grading or reviewing AI outputs for accuracy, helpfulness, and safety.
Requirements
- Gmail
- Google Calendar
- AI Usage
- Scheduling
- Emails
- Google Meetings
How long hiring takes
On the platforms we refer people to, half of hires came within about 25 days of applying. Time from applying to hire:
Why this role
This Gmail & Google Calendar AI Assistant Evaluator role is fully remote and pays $15-30/hr for Generalist work.
Skills and categories
More jobs in these fields:
Related jobs
Verified reviews
Community reviews
Leave your review
Common questions
Can I apply to micro1 from outside the US or UK?
Yes. micro1 accepts applicants from most countries. Most roles need strong written and spoken English.
Does micro1 monitor your computer while you work?
On many projects, yes. Time-tracking tools take screenshots now and then to confirm your hours. Check the project's requirements before you accept it.
Can I choose my own hours?
Usually, yes. You log in when you want, pick up a task, finish it and submit it, with no meetings. Other people work from the same pool of tasks, so some days there may be no work until more is added.
What does Generalist work look like for a Gmail & Google Calendar AI Assistant Evaluator?
You check AI answers to Generalist questions, correct their errors and write expert reasoning. As a Gmail & Google Calendar AI Assistant Evaluator, you're hired for that judgment, so hands-on Generalist experience matters.
What specific skills does this listing call for?
Gmail, Google Calendar, AI Usage, and Scheduling are named directly in the listing. If you don't have hands-on experience with these, expect the screening to test for them.
What does the 'openings' count on this listing mean?
It's how many people micro1 still wants to hire for this role: 50 when we last checked. A high number means more places to fill. The screening stays the same.
How much does this specific role pay?
This listing is posted at $15-30/hr, an hourly rate. Where you land in the range depends on your background and the assessment. Pay can change after we check the listing, so confirm the rate on the platform's application page.
What happens when I click Apply on this listing?
Apply opens micro1's site, where you create an account and follow its sign-up steps.