Freelance AI Evaluation Scenario Writer
Mindrift • India
Education
Master's
Type
Hourly
Pay
$12/hr equivalent
Mindrift pays per task and shows the pay as an hourly rate.
Last checked
5d ago
Checked
About this role
From the Mindrift listing
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift , innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role We’re looking for someone who can design realistic and structured evaluation scenarios for LLM-based agents. You’ll create test cases that simulate human-performed tasks and define gold-standard behavior to compare agent actions against. You’ll work to ensure each scenario is clearly defined, well-scored, and easy to execute and reuse. You’ll need a sharp analytical mindset, attention to detail, and an interest in how AI agents make decisions. Although every project is unique, you might typically: Create structured test cases that simulate complex human workflows. Define gold-standard behavior and scoring logic to evaluate agent actions. Analyze agent logs, failure modes, and decision paths. Work with code repositories and test frameworks to validate your scenarios. Iterate on prompts, instructions, and test cases to improve clarity and difficulty. Ensure that scenarios are production-ready, easy to run, and reusable. How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone.
Requirements
- Must be eligible to work in India
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
Why this role
This Freelance AI Evaluation Scenario Writer role pays $12/hr equivalent for AI training work that uses your Generalist background. Onboarding covers the steps that are new to you.
Skills and categories
More jobs in these fields:
Related jobs
Talk About Everyday Topics, Earn $110 in 90 Minutes
Mindrift • Generalist
$110 /hr equivalent
Paid In-Person Group Conversation Study: $110
Mindrift • Generalist
$110 /hr equivalent
One-Time Paid Research Session in Santa Clara Valley
Mindrift • Generalist
$110 /hr equivalent
Paid Group Discussion Study: $110 for 90 Minutes
Mindrift • Generalist
$110 /hr equivalent
Verified reviews
Community reviews
Leave your review
Common questions
How much does Mindrift pay?
General evaluation tasks, such as fact-checking and tone checks, pay $15-30/hr and don't need an advanced degree. Verified experts can earn $40-100+/hr on specialized projects, so you can start as a generalist and move to a specialist track.
What does a typical Mindrift task involve?
Read a scenario, write a short prompt for the AI (around 100 words), evaluate two AI responses to it, fact-check the outputs, then write a brief explanation (around 50 words) on which response is better against the project rubric. The focus is clarity, safety, and rule-following, not creative writing.
Do creative AI training roles allow creative freedom?
Some. You're hired for your talent, but most projects follow strict style guides, such as a neutral tone or a technical-manual style, so the work stays consistent.
What equipment do I need for creative AI training roles?
Voice and audio roles at this pay level usually need a home studio: an XLR microphone and a quiet, treated room. Quality checks usually reject phone and laptop recordings.
What does Generalist work look like for a Freelance AI Evaluation Scenario Writer?
You check AI answers to Generalist questions, correct their errors and write expert reasoning. As a Freelance AI Evaluation Scenario Writer, you're hired for that judgment, so hands-on Generalist experience matters.
What specific skills does this listing call for?
Review & QA is named directly in the listing. If you don't have hands-on experience with this, expect the screening to test for it.
How much does this specific role pay?
This listing is posted at $12/hr equivalent, an hourly rate. Pay can change after we check the listing, so confirm the rate on the platform's application page.
Do I need a Master's to qualify?
This role lists a master's degree. The domain assessment usually matters more, and if you pass it the degree is often secondary. Some platforms check credentials, so list your qualifications accurately.
Can I apply from outside India?
This role is open only to people based in India. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply.