Skip to content
aitrainer.work - AI Training Jobs Platform

This role may be filled

You can still apply. Platforms often reopen roles or keep applications on file.

Languages Mercor

Internet-Native Bilingual Evaluator Expert (Japanese)

🇯🇵

Mercor • Remote, Japan

Education

Not stated

Type

Hourly

Pay

$30-40/hr

Your rate depends on your experience and the task.

Last checked

21d ago

Checked

About this role

From the Mercor listing

Mercor is seeking Internet-Native Bilingual Evaluator Experts (Japanese–English) to contribute to advanced AI research focused on multilingual communication, internet culture, and contemporary digital language use. This role is ideal for individuals who actively participate in both Japanese- and English-language online communities and understand how internet culture, slang, humour, and social norms differ across languages.

• Analyse content from social media, forums, video platforms, gaming communities, and digital communication channels.

Job Responsibilities

Evaluate Internet-Native Communication

Analyse content from social media, forums, video platforms, gaming communities, and digital communication channels. Assess AI-generated outputs for linguistic quality, cultural relevance, and authenticity. Evaluate internet slang, memes, abbreviations, emoji usage, honorific language, and code-switching.

  • Analyse content from social media, forums, video platforms, gaming communities, and digital communication channels.
  • Assess AI-generated outputs for linguistic quality, cultural relevance, and authenticity.
  • Evaluate internet slang, memes, abbreviations, emoji usage, honorific language, and code-switching.

Develop Evaluation Standards

Create evaluation rubrics for internet-native bilingual communication. Document linguistic and cultural edge cases specific to Japanese and English online communities. Establish standards for tone, appropriateness, and contextual understanding.

  • Create evaluation rubrics for internet-native bilingual communication.
  • Document linguistic and cultural edge cases specific to Japanese and English online communities.
  • Establish standards for tone, appropriateness, and contextual understanding.

Conduct Model Testing and Feedback

Test AI systems using bilingual prompts and real-world internet scenarios. Evaluate outputs in Japanese and English. Provide detailed feedback to improve multilingual model performance.

  • Test AI systems using bilingual prompts and real-world internet scenarios.
  • Evaluate outputs in Japanese and English.
  • Provide detailed feedback to improve multilingual model performance.

Support Quality Assurance

Participate in benchmark development and QA reviews. Ensure consistency and quality across evaluation datasets.

  • Participate in benchmark development and QA reviews.
  • Ensure consistency and quality across evaluation datasets.

Minimum Qualifications

Native or near-native fluency in Japanese and professional fluency in English. Deep familiarity with Japanese and English internet culture. Active engagement with platforms such as X, YouTube, Discord, Reddit, Twitch, Nico Nico, gaming communities, or similar online ecosystems. Strong writing, analytical, and critical thinking skills. Understanding of internet slang, memes, internet etiquette, and online communication norms in both languages. Available to commit 10–20 hours per week.

  • Native or near-native fluency in Japanese and professional fluency in English.
  • Deep familiarity with Japanese and English internet culture.
  • Active engagement with platforms such as X, YouTube, Discord, Reddit, Twitch, Nico Nico, gaming communities, or similar online ecosystems.
  • Strong writing, analytical, and critical thinking skills.
  • Understanding of internet slang, memes, internet etiquette, and online communication norms in both languages.
  • Available to commit 10–20 hours per week.

Preferred Qualifications

Background in linguistics, translation, localisation, journalism, social media, humanities, or AI evaluation. Experience evaluating user-generated content or online communities. Familiarity with internet subcultures, fandoms, gaming communities, and contemporary digital trends. Interest in AI, language models, and multilingual communication research. We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

  • Background in linguistics, translation, localisation, journalism, social media, humanities, or AI evaluation.
  • Experience evaluating user-generated content or online communities.
  • Familiarity with internet subcultures, fandoms, gaming communities, and contemporary digital trends.
  • Interest in AI, language models, and multilingual communication research.

Requirements

  • Must be eligible to work in Japan
  • Fluent proficiency in English (Written & Verbal)
  • Reliable high-speed internet connection

Talent pool members

When your profile is a strong match, we can put you forward to Mercor. Set up your profile first if you haven't.

Set up your profile →

Eligible languages

Fluent proficiency in English or Japanese

English Japanese

Skills and categories

More jobs in these fields:

Related jobs

Verified reviews

Loading reviews…

Community reviews

Loading reviews…
💬

Share your experience with Mercor

Sign in to leave a review

Common questions

Does it cost money to apply to Mercor?

No, applying to and joining Mercor is free. Mercor charges the client a fee on top of your rate. If anyone asks you to pay to join, treat it as a scam.

Is Mercor for freelancers or full-time contractors?

Mercor places you with one client for a set contract, such as 'Python Tutor for 3 months'. Most roles are steady contract work rather than one-off tasks.

What does task-based AI training work look like?

Short, hands-on tasks such as recording videos, sorting images, rating AI answers or checking data. Most take 5 to 60 minutes each.

Can I choose my own hours?

Usually, yes. You log in when you want, pick up a task, finish it and submit it, with no meetings. Other people work from the same pool of tasks, so some days there may be no work until more is added.

What does Languages work look like for an Internet-Native Bilingual Evaluator Expert (Japanese)?

You check AI answers to Languages questions, correct their errors and write expert reasoning. As an Internet-Native Bilingual Evaluator Expert (Japanese), you're hired for that judgment, so hands-on Languages experience matters.

What specific skills does this listing call for?

Bilingual, English, Japanese, and Multilingual are named directly in the listing. If you don't have hands-on experience with these, expect the screening to test for them.

How many hours per week does this role require?

Based on the listing, this role is scoped at 10–20 hours per week. Plan your week around it.

How much does this specific role pay?

This listing is posted at $30-40/hr, an hourly rate. Where you land in the range depends on your background and the assessment. Pay can change after we check the listing, so confirm the rate on the platform's application page.

Do I need to be fluent in English or Japanese?

Yes. This role needs fluent English or Japanese, as well as the English most AI training work uses. If you aren't fluent, search for roles in the languages you speak.

What happens when I click Apply on this listing?

Apply opens Mercor's site, where you create an account and follow its sign-up steps.

Can I apply from outside Japan?

This role is open only to people based in Japan. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply.

How soon will I start working after applying to Mercor?

Usually after a few weeks. Applying puts you in Mercor's pool of candidates, and you start once a client, such as an AI lab, picks your profile.