English (New Zealand) Audio Generalist Evaluator Expert
Mercor • Remote, New Zealand
Education
Not stated
Type
Hourly
Pay
$50/hr
The rate in the listing.
Last checked
4d ago
Checked
Only apply if this role fits your skills and interests.
What we know about this role
- Interview
- Required i As stated in the listing: “10–20 hours per week”
- Weekly hours
- 10–20 hrs/week
About this role
From the Mercor listing
Mercor is seeking an English (New Zealand) Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. In this role, you will work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. This is a short-term, structured engagement ideal for candidates with strong academic or analytical backgrounds who are fluent in New Zealand English and enjoy translating complex audio and visual information into precise, well-structured text.
Job Responsibilities
Transcribe and Optimise Audio & Video
Listen to, analyse, and transcribe audio and video content in English (New Zealand), following detailed constraints and instructions.
Produce high-quality written outputs in English, with supporting work in English when required.
Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines.
Capture nuances such as tone, intent, formal vs. informal register, regional expressions, Māori loanwords, and contemporary New Zealand English usage where relevant.
Define and Document Evaluation Standards
Establish clear expectations for correct and high-quality responses in general consumer audio contexts.
Develop detailed evaluation rubrics and grading guidelines in English.
Document standards to ensure consistency across reviewers and model evaluations.
Identify linguistic nuances, grammatical patterns, colloquialisms, cultural references, and edge cases specific to New Zealand English.
Conduct Model Testing and Grading
Run prompts through language models and assess generated outputs.
Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity.
Provide structured feedback to improve model performance in New Zealand English audio tasks.
Support Benchmarking and Quality Assurance
Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet Mercor’s quality bar.
Maintain consistency and reliability before datasets are integrated into official benchmarks.
Collaborate with project leads to resolve ambiguities and improve task design.
Minimum Qualifications
Strong writing, editing, and critical thinking skills.
Ability to work independently, manage time effectively, and meet deadlines.
Native or near-native fluency in English (New Zealand) (spoken and written).
Strong familiarity with New Zealand English, regional vocabulary, accents, Māori influences, and contemporary language usage.
Ability to accurately transcribe and analyse English audio content across general consumer contexts.
Available to commit 10–20 hours per week.
Preferred Qualifications
College students or recent graduates.
Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines.
Prior experience with transcription, annotation, localisation, evaluation, or research workflows in English.
Familiarity with differences between New Zealand English, Australian English, and other major English varieties.
Interest in AI, language models, or applied research environments.
Application & Onboarding Process
Complete a short AI-led interview (approximately 15 minutes).
If selected, you will be onboarded and invited to begin project work.
Requirements
- Must be eligible to work in New Zealand
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- Bachelor's degree or equivalent professional experience
- Demonstrated expertise in Languages
How long hiring takes
On the platforms we refer people to, half of hires came within about 25 days of applying. Time from applying to hire:
Talent pool members
When your profile is a strong match, we can put you forward to Mercor. Set up your profile first if you haven't.
Set up your profile →Typical contract length
Across 64 Mercor Languages listings we've tracked, contracts typically run about 23.5 weeks. Length varies by project.
Eligible languages
Fluent proficiency in Australian English or English
Why this role
This English (New Zealand) Audio Generalist Evaluator Expert role pays $50/hr for your Languages judgment.
Talent pool
We're light on Languages candidates
We've tracked 1,407 Languages listings and have few candidates to put forward for them. Set up a profile and we'll consider you for roles like this one.
Set up your profileSkills and categories
More jobs in these fields:
Related jobs
Verified reviews
Community reviews
Leave your review
Common questions
Does Mercor's application require an on-camera interview?
Yes. You record a video interview with an AI interviewer that asks about your resume, and clients watch it before they hire, so plan to be on camera.
Does it cost money to apply to Mercor?
No, applying to and joining Mercor is free. Mercor charges the client a fee on top of your rate. If anyone asks you to pay to join, treat it as a scam.
Do creative AI training roles allow creative freedom?
Some. You're hired for your talent, but most projects follow strict style guides, such as a neutral tone or a technical-manual style, so the work stays consistent.
What equipment do I need for creative AI training roles?
Voice and audio roles at this pay level usually need a home studio: an XLR microphone and a quiet, treated room. Quality checks usually reject phone and laptop recordings.
What does Languages work look like for an English (New Zealand) Audio Generalist Evaluator Expert?
You check AI answers to Languages questions, correct their errors and write expert reasoning. As an English (New Zealand) Audio Generalist Evaluator Expert, you're hired for that judgment, so hands-on Languages experience matters.
What specific skills does this listing call for?
Australian English and English are named directly in the listing. If you don't have hands-on experience with these, expect the screening to test for them.
How many hours per week does this role require?
Based on the listing, this role is scoped at 10–20 hours per week. Plan your week around it.
How much does this specific role pay?
This listing is posted at $50/hr, an hourly rate. Pay can change after we check the listing, so confirm the rate on the platform's application page.
Do I need to be fluent in Australian English or English?
Yes. This role needs fluent Australian English or English, as well as the English most AI training work uses. If you aren't fluent, search for roles in the languages you speak.
What happens when I click Apply on this listing?
Apply opens Mercor's site, where you create an account and follow its sign-up steps.
Can I apply from outside New Zealand?
This role is open only to people based in New Zealand. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply.
Is there an interview?
Yes. interview (approximately 15 minutes)
How soon will I start working after applying to Mercor?
Usually after a few weeks. Applying puts you in Mercor's pool of candidates, and you start once a client, such as an AI lab, picks your profile.