Skip to content
aitrainer.work - AI Training Jobs Platform
Mathematics Mercor

Generalist - English & Japanese

🇯🇵

Mercor • Remote, Japan, United States

Education

Master's

Type

Hourly

Pay

$16-36/hr

Your rate depends on your experience and the task.

Last checked

3d ago

Checked

Only apply if this role fits your skills and interests.

Send this job to a friend

New roles in Telegram: @aitrainerwork

About this role

From the Mercor listing

Location: Geography restricted to Japan, USA Type: Full-time or Part-time Contract Work Fluent Language Skills Required: English & Japanese

Why This Role Exists

  • Evaluate LLM-generated responses on their ability to effectively answer user queries
  • Conduct fact-checking using trusted public sources and external tools
  • Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies
  • Assess reasoning quality, clarity, tone, and completeness of responses
  • Ensure model responses align with expected conversational behavior and system guidelines
  • Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines
  • You hold a Bachelor’s degree
  • You are a native speaker or have ILR 5/primary fluency (C2 on the CEFR scale) in Japanese
  • You have significant experience using large language models (LLMs) and understand how and why people use them
  • You have excellent writing skills and can clearly articulate nuanced feedback
  • You have strong attention to detail and consistently notice subtle issues others may overlook
  • You are adaptable and comfortable moving across topics, domains, and customer requirements
  • You have a background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering)
  • You have excellent college-level mathematics skills
  • Prior experience with RLHF, model evaluation, or data annotation work
  • Experience writing or editing high-quality written content
  • Experience comparing multiple outputs and making fine-grained qualitative judgments
  • Familiarity with evaluation rubrics, benchmarks, or quality scoring systems
  • You identify factual inaccuracies, reasoning errors, and communication gaps in model responses
  • You produce clear, consistent, and reproducible evaluation artifacts
  • Your feedback leads to measurable improvements in response quality and user experience
  • Mercor customers trust the quality of their AI systems because your evaluations surface issues before public release

Requirements

  • Must be eligible to work in one of: Japan, United States
  • Fluent proficiency in English (Written & Verbal)
  • Reliable high-speed internet connection

How long hiring takes

On the platforms we refer people to, half of hires came within about 25 days of applying. Time from applying to hire:

Under 2 weeks
~30%
2 weeks to 6 weeks
~40%
6 weeks to 3 months
~15%
Over 3 months
~15%

Talent pool members

When your profile is a strong match, we can put you forward to Mercor. Set up your profile first if you haven't.

Set up your profile →

Eligible languages

Fluent proficiency in English or Japanese

English Japanese

Why this role

This Generalist - English & Japanese role pays $16-36/hr and is fully remote, so you can do Mathematics work for an AI lab from home.

Talent pool

We're light on Mathematics candidates

We've tracked 1,040 Mathematics listings and have few candidates to put forward for them. Set up a profile and we'll consider you for roles like this one.

Set up your profile

Skills and categories

More jobs in these fields:

Related jobs

Verified reviews

Loading reviews…

Community reviews

Loading reviews…
💬

Share your experience with Mercor

Sign in to leave a review

Common questions

Does Mercor's application require an on-camera interview?

Yes. You record a video interview with an AI interviewer that asks about your resume, and clients watch it before they hire, so plan to be on camera.

Does it cost money to apply to Mercor?

No, applying to and joining Mercor is free. Mercor charges the client a fee on top of your rate. If anyone asks you to pay to join, treat it as a scam.

What does task-based AI training work look like?

Short, hands-on tasks such as recording videos, sorting images, rating AI answers or checking data. Most take 5 to 60 minutes each.

What does Mathematics work look like for a Generalist - English & Japanese?

You check AI answers to Mathematics questions, correct their errors and write expert reasoning. As a Generalist - English & Japanese, you're hired for that judgment, so hands-on Mathematics experience matters.

What specific skills does this listing call for?

English, Japanese, and Native Speaker are named directly in the listing. If you don't have hands-on experience with these, expect the screening to test for them.

How much does this specific role pay?

This listing is posted at $16-36/hr, an hourly rate. Where you land in the range depends on your background and the assessment. Pay can change after we check the listing, so confirm the rate on the platform's application page.

Do I need to be fluent in English or Japanese?

Yes. This role needs fluent English or Japanese, as well as the English most AI training work uses. If you aren't fluent, search for roles in the languages you speak.

What happens when I click Apply on this listing?

Apply opens Mercor's site, where you create an account and follow its sign-up steps.

Do I need a Master's to qualify?

This role lists a master's degree. The domain assessment usually matters more, and if you pass it the degree is often secondary. Some platforms check credentials, so list your qualifications accurately.

Can I apply from outside Japan or the United States?

This role is open only to people based in Japan and the United States. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply, since they can differ by country.

How soon will I start working after applying to Mercor?

Usually after a few weeks. Applying puts you in Mercor's pool of candidates, and you start once a client, such as an AI lab, picks your profile.