This role may be filled
You can still apply. Platforms often reopen roles or keep applications on file.
Internet-Native Bilingual Evaluator Expert (Japanese)
Mercor • Remote, Japan
Education
Not stated
Type
Hourly
Pay
$30-40/hr
Your rate depends on your experience and the task.
Last checked
21d ago
Checked
About this role
From the Mercor listing
Mercor is seeking Internet-Native Bilingual Evaluator Experts (Japanese–English) to contribute to advanced AI research focused on multilingual communication, internet culture, and contemporary digital language use. This role is ideal for individuals who actively participate in both Japanese- and English-language online communities and understand how internet culture, slang, humour, and social norms differ across languages.
• Analyse content from social media, forums, video platforms, gaming communities, and digital communication channels.
Job Responsibilities
Evaluate Internet-Native Communication
Analyse content from social media, forums, video platforms, gaming communities, and digital communication channels. Assess AI-generated outputs for linguistic quality, cultural relevance, and authenticity. Evaluate internet slang, memes, abbreviations, emoji usage, honorific language, and code-switching.
- Analyse content from social media, forums, video platforms, gaming communities, and digital communication channels.
- Assess AI-generated outputs for linguistic quality, cultural relevance, and authenticity.
- Evaluate internet slang, memes, abbreviations, emoji usage, honorific language, and code-switching.
Develop Evaluation Standards
Create evaluation rubrics for internet-native bilingual communication. Document linguistic and cultural edge cases specific to Japanese and English online communities. Establish standards for tone, appropriateness, and contextual understanding.
- Create evaluation rubrics for internet-native bilingual communication.
- Document linguistic and cultural edge cases specific to Japanese and English online communities.
- Establish standards for tone, appropriateness, and contextual understanding.
Conduct Model Testing and Feedback
Test AI systems using bilingual prompts and real-world internet scenarios. Evaluate outputs in Japanese and English. Provide detailed feedback to improve multilingual model performance.
- Test AI systems using bilingual prompts and real-world internet scenarios.
- Evaluate outputs in Japanese and English.
- Provide detailed feedback to improve multilingual model performance.
Support Quality Assurance
Participate in benchmark development and QA reviews. Ensure consistency and quality across evaluation datasets.
- Participate in benchmark development and QA reviews.
- Ensure consistency and quality across evaluation datasets.
Minimum Qualifications
Native or near-native fluency in Japanese and professional fluency in English. Deep familiarity with Japanese and English internet culture. Active engagement with platforms such as X, YouTube, Discord, Reddit, Twitch, Nico Nico, gaming communities, or similar online ecosystems. Strong writing, analytical, and critical thinking skills. Understanding of internet slang, memes, internet etiquette, and online communication norms in both languages. Available to commit 10–20 hours per week.
- Native or near-native fluency in Japanese and professional fluency in English.
- Deep familiarity with Japanese and English internet culture.
- Active engagement with platforms such as X, YouTube, Discord, Reddit, Twitch, Nico Nico, gaming communities, or similar online ecosystems.
- Strong writing, analytical, and critical thinking skills.
- Understanding of internet slang, memes, internet etiquette, and online communication norms in both languages.
- Available to commit 10–20 hours per week.
Preferred Qualifications
Background in linguistics, translation, localisation, journalism, social media, humanities, or AI evaluation. Experience evaluating user-generated content or online communities. Familiarity with internet subcultures, fandoms, gaming communities, and contemporary digital trends. Interest in AI, language models, and multilingual communication research. We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
- Background in linguistics, translation, localisation, journalism, social media, humanities, or AI evaluation.
- Experience evaluating user-generated content or online communities.
- Familiarity with internet subcultures, fandoms, gaming communities, and contemporary digital trends.
- Interest in AI, language models, and multilingual communication research.
Requirements
- Must be eligible to work in Japan
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
Talent pool members
When your profile is a strong match, we can put you forward to Mercor. Set up your profile first if you haven't.
Set up your profile →Eligible languages
Fluent proficiency in English or Japanese
Skills and categories
More jobs in these fields:
Related jobs
Verified reviews
Community reviews
Leave your review
Common questions
Does it cost money to apply to Mercor?
No, applying to and joining Mercor is free. Mercor charges the client a fee on top of your rate. If anyone asks you to pay to join, treat it as a scam.
Is Mercor for freelancers or full-time contractors?
Mercor places you with one client for a set contract, such as 'Python Tutor for 3 months'. Most roles are steady contract work rather than one-off tasks.
What does task-based AI training work look like?
Short, hands-on tasks such as recording videos, sorting images, rating AI answers or checking data. Most take 5 to 60 minutes each.
Can I choose my own hours?
Usually, yes. You log in when you want, pick up a task, finish it and submit it, with no meetings. Other people work from the same pool of tasks, so some days there may be no work until more is added.
What does Languages work look like for an Internet-Native Bilingual Evaluator Expert (Japanese)?
You check AI answers to Languages questions, correct their errors and write expert reasoning. As an Internet-Native Bilingual Evaluator Expert (Japanese), you're hired for that judgment, so hands-on Languages experience matters.
What specific skills does this listing call for?
Bilingual, English, Japanese, and Multilingual are named directly in the listing. If you don't have hands-on experience with these, expect the screening to test for them.
How many hours per week does this role require?
Based on the listing, this role is scoped at 10–20 hours per week. Plan your week around it.
How much does this specific role pay?
This listing is posted at $30-40/hr, an hourly rate. Where you land in the range depends on your background and the assessment. Pay can change after we check the listing, so confirm the rate on the platform's application page.
Do I need to be fluent in English or Japanese?
Yes. This role needs fluent English or Japanese, as well as the English most AI training work uses. If you aren't fluent, search for roles in the languages you speak.
What happens when I click Apply on this listing?
Apply opens Mercor's site, where you create an account and follow its sign-up steps.
Can I apply from outside Japan?
This role is open only to people based in Japan. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply.
How soon will I start working after applying to Mercor?
Usually after a few weeks. Applying puts you in Mercor's pool of candidates, and you start once a client, such as an AI lab, picks your profile.