Skip to content
aitrainer.work - AI Training Jobs Platform
Languages Mercor

Russian Audio Generalist Evaluator Expert (San Francisco Bay Area)

🇷🇺

Mercor • Remote

Education

Bachelor's

Type

Hourly

Pay

$50/hr

The rate in the listing.

Last checked

3d ago

Checked

Only apply if this role fits your skills and interests.

Send this job to a friend

New roles in Telegram: @aitrainerwork

What we know about this role

Interview
Required i As stated in the listing: “10–20 hours per week”
Weekly hours
10–20 hrs/week

About this role

From the Mercor listing

Mercor is seeking a Russian Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. In this role, you will work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. This is a short-term, structured engagement ideal for candidates with strong academic or analytical backgrounds who are fluent in Russian and English and are based in the San Francisco Bay Area, enabling occasional in-person collaboration if required.

Job Responsibilities

Transcribe and Optimise Audio & Video

  • Listen to, analyse, and transcribe audio and video content in Russian, following detailed constraints and instructions.

  • Produce high-quality written outputs in Russian, with supporting work in English when required.

  • Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines.

  • Capture nuances such as tone, intent, formal vs. informal register, regional expressions, dialectal variations, and contemporary Russian usage where relevant.

Define and Document Evaluation Standards

  • Establish clear expectations for correct and high-quality responses in general consumer audio contexts.

  • Develop detailed evaluation rubrics and grading guidelines in Russian and English.

  • Document standards to ensure consistency across reviewers and model evaluations.

  • Identify linguistic nuances, grammatical complexities, colloquialisms, and edge cases specific to Russian.

Conduct Model Testing and Grading

  • Run prompts through language models and assess generated outputs.

  • Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity.

  • Provide structured feedback to improve model performance in Russian audio tasks.

Support Benchmarking and Quality Assurance

  • Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet Mercor’s quality bar.

  • Maintain consistency and reliability before datasets are integrated into official benchmarks.

  • Collaborate with project leads to resolve ambiguities and improve task design.

Minimum Qualifications

  • Strong writing, editing, and critical thinking skills.

  • Ability to work independently, manage time effectively, and meet deadlines.

  • Native or near-native fluency in Russian (spoken and written) and professional fluency in English.

  • Strong familiarity with spoken Russian, regional vocabulary, dialects, and contemporary language usage.

  • Ability to accurately transcribe and analyse Russian audio content across general consumer contexts.

  • Must be based in the San Francisco Bay Area.

  • Available to commit 10–20 hours per week.

Preferred Qualifications

  • College students or recent graduates.

  • Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines.

  • Prior experience with transcription, annotation, localisation, evaluation, or research workflows in Russian.

  • Familiarity with regional variations of Russian and contemporary digital language usage.

  • Interest in AI, language models, or applied research environments.

Application & Onboarding Process

  • Complete a short AI-led interview (approximately 15 minutes).

  • If selected, you will be onboarded and invited to begin project work.

Requirements

  • Fluent proficiency in English (Written & Verbal)
  • Reliable high-speed internet connection
  • Bachelor's's degree or equivalent professional experience
  • Demonstrated expertise in Languages

How long hiring takes

On the platforms we refer people to, half of hires came within about 25 days of applying. Time from applying to hire:

Under 2 weeks
~30%
2 weeks to 6 weeks
~40%
6 weeks to 3 months
~15%
Over 3 months
~15%

Talent pool members

When your profile is a strong match, we can put you forward to Mercor. Set up your profile first if you haven't.

Set up your profile →

Typical contract length

Across 64 Mercor Languages listings we've tracked, contracts typically run about 23.5 weeks. Length varies by project.

Eligible languages

Fluent proficiency in English or Russian

English Russian

Why this role

This Russian Audio Generalist Evaluator Expert (San Francisco Bay Area) role pays $50/hr to review and correct AI work in Languages, using expertise you already have.

Talent pool

We're light on Languages candidates

We've tracked 1,407 Languages listings and have few candidates to put forward for them. Set up a profile and we'll consider you for roles like this one.

Set up your profile

Skills and categories

More jobs in these fields:

Related jobs

Verified reviews

Loading reviews…

Community reviews

Loading reviews…
💬

Share your experience with Mercor

Sign in to leave a review

Common questions

Does it cost money to apply to Mercor?

No, applying to and joining Mercor is free. Mercor charges the client a fee on top of your rate. If anyone asks you to pay to join, treat it as a scam.

Is Mercor for freelancers or full-time contractors?

Mercor places you with one client for a set contract, such as 'Python Tutor for 3 months'. Most roles are steady contract work rather than one-off tasks.

What equipment do I need for creative AI training roles?

Voice and audio roles at this pay level usually need a home studio: an XLR microphone and a quiet, treated room. Quality checks usually reject phone and laptop recordings.

How is my creative work used in AI training?

Your work becomes examples the model learns from. Writing samples teach it to write, and voice recordings often train text-to-speech models. Read the contract's terms on how your voice or likeness can be used before you sign.

What does Languages work look like for a Russian Audio Generalist Evaluator Expert (San Francisco Bay Area)?

You check AI answers to Languages questions, correct their errors and write expert reasoning. As a Russian Audio Generalist Evaluator Expert (San Francisco Bay Area), you're hired for that judgment, so hands-on Languages experience matters.

What specific skills does this listing call for?

English and Russian are named directly in the listing. If you don't have hands-on experience with these, expect the screening to test for them.

How many hours per week does this role require?

Based on the listing, this role is scoped at 10–20 hours per week. Plan your week around it.

How much does this specific role pay?

This listing is posted at $50/hr, an hourly rate. Pay can change after we check the listing, so confirm the rate on the platform's application page.

Do I need to be fluent in English or Russian?

Yes. This role needs fluent English or Russian, as well as the English most AI training work uses. If you aren't fluent, search for roles in the languages you speak.

What happens when I click Apply on this listing?

Apply opens Mercor's site, where you create an account and follow its sign-up steps.

Is there an interview?

Yes. interview (approximately 15 minutes)

How soon will I start working after applying to Mercor?

Usually after a few weeks. Applying puts you in Mercor's pool of candidates, and you start once a client, such as an AI lab, picks your profile.