Skip to content
aitrainer.work - AI Training Jobs Platform
Generalist Mercor

Baseball Fan – Live MLB Game AI Evaluator (US)

Mercor • Remote, United States

Education

Not stated

Type

Hourly

Pay

$100-120/hr

Your rate depends on your experience and the task.

Last checked

Today

Checked

Only apply if this role fits your skills and interests.

Send this job to a friend

New roles in Telegram: @aitrainerwork

About this role

From the Mercor listing

Role overview

Mercor is looking for US-based people with strong baseball knowledge to evaluate AI assistants live, while real MLB games are being played. On scheduled game days, you'll ask AI assistants the questions you'd naturally ask while following a game, then rate how helpful, accurate, and well-presented their answers are. Your judgments directly shape how AI products serve sports fans.

What you'll do

  • Follow live MLB postseason games and ask AI assistants real fan questions: live scores and win probability, player and team stats, rules and challenges, schedules and broadcasts, highlights, and expert-style analysis

  • Run the same question on two AI products side by side, either as a single question or as a multi-turn conversation of 2 to 10 turns

  • Capture share links and full screenshots of every conversation

  • Rate each response for helpfulness, factual accuracy, and presentation, choose which product did better, and write a clear rationale for your choice

What we're looking for

  • Based in the United States

  • At least 1 year of professional work experience

  • Solid baseball knowledge: rules, teams, players, and how the postseason works

  • Being an avid MLB fan or a general sports enthusiast is a plus

  • Available to work live during game windows on scheduled game days

  • Comfortable using AI chat assistants and web search

  • Strong written English, sharp attention to detail, and the ability to spot factual errors

  • Prior AI rating or evaluation experience is a plus, but not required

Details

  • Event-based: work happens on MLB postseason game days in October, from the Division Series through the World Series

  • Each task takes about 2 to 2.5 hours and is completed while the game is live

  • The first game day is as early as Saturday, October 3

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

How long hiring takes

On the platforms we refer people to, half of hires came within about 25 days of applying. Time from applying to hire:

Under 2 weeks
~30%
2 weeks to 6 weeks
~40%
6 weeks to 3 months
~15%
Over 3 months
~15%

Talent pool members

When your profile is a strong match, we can put you forward to Mercor. Set up your profile first if you haven't.

Set up your profile →

Typical contract length

Across 10 Mercor Generalist listings we've tracked, contracts typically run about 6.8 weeks. Length varies by project.

Why this role

This Baseball Fan – Live MLB Game AI Evaluator (US) role pays $100-120/hr for Generalist work, without finding or billing your own clients.

Skills and categories

More jobs in these fields:

Related jobs

Verified reviews

Loading reviews…

Community reviews

Loading reviews…
💬

Share your experience with Mercor

Sign in to leave a review

Common questions

Does Mercor's application require an on-camera interview?

Yes. You record a video interview with an AI interviewer that asks about your resume, and clients watch it before they hire, so plan to be on camera.

Does it cost money to apply to Mercor?

No, applying to and joining Mercor is free. Mercor charges the client a fee on top of your rate. If anyone asks you to pay to join, treat it as a scam.

What does a typical day look like in expert AI training work?

Tasks are slow and careful. One task can take 45 to 60 minutes of checking citations or calculations, and you're judged on quality more than speed.

Is AI training work the same as traditional consulting?

It's closer to teaching. You grade the AI's logic, correct its mistakes and write the expert reasoning it lacks, instead of producing work for a client.

What does Generalist work look like for a Baseball Fan – Live MLB Game AI Evaluator (US)?

You check AI answers to Generalist questions, correct their errors and write expert reasoning. As a Baseball Fan – Live MLB Game AI Evaluator (US), you're hired for that judgment, so hands-on Generalist experience matters.

What specific skills does this listing call for?

English is named directly in the listing. If you don't have hands-on experience with this, expect the screening to test for it.

How much does this specific role pay?

This listing is posted at $100-120/hr, an hourly rate. Where you land in the range depends on your background and the assessment. Pay can change after we check the listing, so confirm the rate on the platform's application page.

What happens when I click Apply on this listing?

Apply opens Mercor's site, where you create an account and follow its sign-up steps.

Can I apply from outside the United States?

This role is open only to people based in the United States. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply.

How soon will I start working after applying to Mercor?

Usually after a few weeks. Applying puts you in Mercor's pool of candidates, and you start once a client, such as an AI lab, picks your profile.