AI Voice Evaluation Specialist
Innodata • Remote - Alabama ; Remote - Alaska ; Remote - Arkansas ; Remote - Delaware ; Remote - Florida ; Remote - Georgia ; Remote - Indiana ; Remote - Maryland ; Remote - Massachusetts ; Remote - New Hampshire ; Remote - New Jersey ; Remote - New York ; Remote - South Carolina ; Remote - Texas
Education
Not stated
Type
Hourly
Pay
$20-25/hr
Your rate depends on your experience and the task.
Last checked
Today
Checked
About this role
From the Innodata listing
Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers. Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact with two different AI models using the same assigned scenario, carefully compare their responses, and provide structured evaluations based on defined quality criteria. The goal of the evaluation is to create a fair, consistent comparison between models and identify which model delivers the stronger overall conversational experience. What You’ll Own: Review an assigned scenario and roleplay a natural conversation with two different AI models . Conduct comparable conversations with Model A and Model B, keeping the scenario, conversational approach, and overall interaction as consistent as possible. Maintain approximately the same number of conversational turns with each model to support a fair comparison. Record your voice during each interaction and pay close attention to the quality and behavior of the model's responses. Evaluate each model across five defined evaluation dimensions . Identify and categorize relevant error clusters that may occur in the audio or conversation. Compare the performance of Model A and Model B based on the evaluation criteria and your observations. Select the model that demonstrated the stronger overall performance according to the defined evaluation framework. Write a detailed rationale explaining your final preference, referencing specific examples and observations from both conversations. Apply evaluation guidelines consistently across different scenarios and model interactions You’ll Thrive in This Role If You Have Bachelors Degree Strong attention to detail and ability to notice subtle differences in conversational quality. Excellent listening and comprehension skills. Strong written communication skills, particularly the ability to explain observations clearly and objectively. Ability to follow detailed evaluation guidelines consistently. Comfort speaking naturally and roleplaying different conversational scenarios. Ability to compare two interactions fairly without allowing personal preferences to influence the evaluation. Strong critical-thinking and analytical skills. Reliability and consistency when completing structured evaluation tasks. Familiarity with AI assistants, voice-based AI, or conversational systems The expected hourly salary range for this position is $20-$25 p/hour, based on experience, skills, and qualifications. Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams. If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at [email protected] and consider reporting it to the FTC at ReportFraud.ftc.gov .
Requirements
- Must be eligible to work in Remote - Alabama ; Remote - Alaska ; Remote - Arkansas ; Remote - Delaware ; Remote - Florida ; Remote - Georgia ; Remote - Indiana ; Remote - Maryland ; Remote - Massachusetts ; Remote - New Hampshire ; Remote - New Jersey ; Remote - New York ; Remote - South Carolina ; Remote - Texas
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
Why this role
At $20-25/hr, this AI Voice Evaluation Specialist position pays for what you know about Generalist. Onboarding covers the AI training side.
Skills and categories
More jobs in these fields:
Related jobs
Generative AI Associate - Masters/PHD - Flexible Hours
Innodata • Generalist
$25 /hr
Generative AI Associate Vietnamese Speaking - Flexible Hours
Innodata • Generalist
$15 /hr
Generative AI Associate Turkish Speaking - Flexible Hours
Innodata • Generalist
$20 /hr
Generative AI Associate Russian Speaking - Flexible Hours
Innodata • Generalist
$15 /hr
Verified reviews
Community reviews
Leave your review
Common questions
What equipment do I need for creative AI training roles?
Voice and audio roles at this pay level usually need a home studio: an XLR microphone and a quiet, treated room. Quality checks usually reject phone and laptop recordings.
How is my creative work used in AI training?
Your work becomes examples the model learns from. Writing samples teach it to write, and voice recordings often train text-to-speech models. Read the contract's terms on how your voice or likeness can be used before you sign.
What does Generalist work look like for an AI Voice Evaluation Specialist?
You check AI answers to Generalist questions, correct their errors and write expert reasoning. As an AI Voice Evaluation Specialist, you're hired for that judgment, so hands-on Generalist experience matters.
How much does this specific role pay?
This listing is posted at $20-25/hr, an hourly rate. Where you land in the range depends on your background and the assessment. Pay can change after we check the listing, so confirm the rate on the platform's application page.
Can I apply from outside Remote - Alabama ; Remote - Alaska ; Remote - Arkansas ; Remote - Delaware ; Remote - Florida ; Remote - Georgia ; Remote - Indiana ; Remote - Maryland ; Remote - Massachusetts ; Remote - New Hampshire ; Remote - New Jersey ; Remote - New York ; Remote - South Carolina ; Remote - Texas?
This role is open only to people based in Remote - Alabama ; Remote - Alaska ; Remote - Arkansas ; Remote - Delaware ; Remote - Florida ; Remote - Georgia ; Remote - Indiana ; Remote - Maryland ; Remote - Massachusetts ; Remote - New Hampshire ; Remote - New Jersey ; Remote - New York ; Remote - South Carolina ; Remote - Texas. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply.