AI Agentic Workflow Reviewer
Innodata • In Office - San Jose, California
Education
Not stated
Type
Hourly
Pay
$50-55/hr
Your rate depends on your experience and the task.
Last checked
Today
Checked
About this role
From the Innodata listing
Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers. Scope of the Role: We're building a dedicated reviewer team to evaluate complex, real-world agentic AI workflows, assessing whether AI agents complete tasks safely, respect user intent and consent, and hold up under close scrutiny. This isn't routine content moderation: reviewers work through ambiguous, multi-step scenarios where judgment calls matter as much as checklists. You'll operate inside isolated test environments, apply structured rubrics, and help calibrate what "safe and policy adherent agent behavior" actually looks like. What You’ll Own: Review multi-step agent task trajectories against rubric-based criteria covering task success, safety, and policy adherence Evaluate whether an agent respected user agency and informed consent — not just whether it followed literal instructions Apply privacy guardrails when reviewing tasks involving sensitive or personal data Work inside isolated test environments, including verifying environment resets between test runs to prevent cross-contamination Flag and escalate safety-relevant or ambiguous findings through defined escalation paths You’ll Thrive in This Role If You Have: Bachelor's degree or equivalent practical experience 2–5+ years in quality review, QA/QC, trust & safety, content moderation, data annotation, or a similarly judgment-intensive review role Strong written communication – you can justify a scoring decision clearly enough for someone else to audit it Comfort with ambiguity and structured decision-making under a rubric, rather than needing a fixed rulebook for every case Baseline understanding of AI/ML concepts and how AI agents complete tasks (can be learned through onboarding, but some familiarity helps) The expected hourly salary range for this position is $50-$55p/hour, based on experience, skills, and qualifications. Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams. If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at [email protected] and consider reporting it to the FTC at ReportFraud.ftc.gov .
Requirements
- Must be eligible to work in In Office - San Jose, California
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- Bachelor's degree or equivalent professional experience
- Demonstrated expertise in Generalist
Why this role
This AI Agentic Workflow Reviewer role pays $50-55/hr for AI training work that uses your Generalist background. Onboarding covers the steps that are new to you.
Skills and categories
More jobs in these fields:
Related jobs
Generative AI Associate - Masters/PHD - Flexible Hours
Innodata • Generalist
$25 /hr
Generative AI Associate Vietnamese Speaking - Flexible Hours
Innodata • Generalist
$15 /hr
Generative AI Associate Turkish Speaking - Flexible Hours
Innodata • Generalist
$20 /hr
Generative AI Associate Russian Speaking - Flexible Hours
Innodata • Generalist
$15 /hr
Verified reviews
Community reviews
Leave your review
Common questions
What does task-based AI training work look like?
Short, hands-on tasks such as recording videos, sorting images, rating AI answers or checking data. Most take 5 to 60 minutes each.
Can I choose my own hours?
Usually, yes. You log in when you want, pick up a task, finish it and submit it, with no meetings. Other people work from the same pool of tasks, so some days there may be no work until more is added.
What does Generalist work look like for an AI Agentic Workflow Reviewer?
You check AI answers to Generalist questions, correct their errors and write expert reasoning. As an AI Agentic Workflow Reviewer, you're hired for that judgment, so hands-on Generalist experience matters.
What specific skills does this listing call for?
Data Annotation is named directly in the listing. If you don't have hands-on experience with this, expect the screening to test for it.
How much does this specific role pay?
This listing is posted at $50-55/hr, an hourly rate. Where you land in the range depends on your background and the assessment. Pay can change after we check the listing, so confirm the rate on the platform's application page.
Can I apply from outside In Office - San Jose, California?
This role is open only to people based in In Office - San Jose, California. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply.