Generalist - English & Japanese
Mercor • Remote, Japan, United States
Education
Master's
Type
Hourly
Pay
$16-36/hr
Your rate depends on your experience and the task.
Last checked
3d ago
Checked
Only apply if this role fits your skills and interests.
About this role
From the Mercor listing
Location: Geography restricted to Japan, USA Type: Full-time or Part-time Contract Work Fluent Language Skills Required: English & Japanese
Why This Role Exists
- Evaluate LLM-generated responses on their ability to effectively answer user queries
- Conduct fact-checking using trusted public sources and external tools
- Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies
- Assess reasoning quality, clarity, tone, and completeness of responses
- Ensure model responses align with expected conversational behavior and system guidelines
- Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines
- You hold a Bachelor’s degree
- You are a native speaker or have ILR 5/primary fluency (C2 on the CEFR scale) in Japanese
- You have significant experience using large language models (LLMs) and understand how and why people use them
- You have excellent writing skills and can clearly articulate nuanced feedback
- You have strong attention to detail and consistently notice subtle issues others may overlook
- You are adaptable and comfortable moving across topics, domains, and customer requirements
- You have a background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering)
- You have excellent college-level mathematics skills
- Prior experience with RLHF, model evaluation, or data annotation work
- Experience writing or editing high-quality written content
- Experience comparing multiple outputs and making fine-grained qualitative judgments
- Familiarity with evaluation rubrics, benchmarks, or quality scoring systems
- You identify factual inaccuracies, reasoning errors, and communication gaps in model responses
- You produce clear, consistent, and reproducible evaluation artifacts
- Your feedback leads to measurable improvements in response quality and user experience
- Mercor customers trust the quality of their AI systems because your evaluations surface issues before public release
Requirements
- Must be eligible to work in one of: Japan, United States
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
How long hiring takes
On the platforms we refer people to, half of hires came within about 25 days of applying. Time from applying to hire:
Talent pool members
When your profile is a strong match, we can put you forward to Mercor. Set up your profile first if you haven't.
Set up your profile →Eligible languages
Fluent proficiency in English or Japanese
Why this role
This Generalist - English & Japanese role pays $16-36/hr and is fully remote, so you can do Mathematics work for an AI lab from home.
Talent pool
We're light on Mathematics candidates
We've tracked 1,040 Mathematics listings and have few candidates to put forward for them. Set up a profile and we'll consider you for roles like this one.
Set up your profileSkills and categories
More jobs in these fields:
Related jobs
Verified reviews
Community reviews
Leave your review
Common questions
Does Mercor's application require an on-camera interview?
Yes. You record a video interview with an AI interviewer that asks about your resume, and clients watch it before they hire, so plan to be on camera.
Does it cost money to apply to Mercor?
No, applying to and joining Mercor is free. Mercor charges the client a fee on top of your rate. If anyone asks you to pay to join, treat it as a scam.
What does task-based AI training work look like?
Short, hands-on tasks such as recording videos, sorting images, rating AI answers or checking data. Most take 5 to 60 minutes each.
What does Mathematics work look like for a Generalist - English & Japanese?
You check AI answers to Mathematics questions, correct their errors and write expert reasoning. As a Generalist - English & Japanese, you're hired for that judgment, so hands-on Mathematics experience matters.
What specific skills does this listing call for?
English, Japanese, and Native Speaker are named directly in the listing. If you don't have hands-on experience with these, expect the screening to test for them.
How much does this specific role pay?
This listing is posted at $16-36/hr, an hourly rate. Where you land in the range depends on your background and the assessment. Pay can change after we check the listing, so confirm the rate on the platform's application page.
Do I need to be fluent in English or Japanese?
Yes. This role needs fluent English or Japanese, as well as the English most AI training work uses. If you aren't fluent, search for roles in the languages you speak.
What happens when I click Apply on this listing?
Apply opens Mercor's site, where you create an account and follow its sign-up steps.
Do I need a Master's to qualify?
This role lists a master's degree. The domain assessment usually matters more, and if you pass it the degree is often secondary. Some platforms check credentials, so list your qualifications accurately.
Can I apply from outside Japan or the United States?
This role is open only to people based in Japan and the United States. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply, since they can differ by country.
How soon will I start working after applying to Mercor?
Usually after a few weeks. Applying puts you in Mercor's pool of candidates, and you start once a client, such as an AI lab, picks your profile.