Math Reasoning RLHF Annotator
Claru • Remote
Education
Not stated
Type
Hourly
Pay
$35-55/hr
Your rate depends on your experience and the task.
Last checked
5d ago
Checked
About this role
From the Claru listing
You'll spend your time evaluating model-generated solutions to math problems — ranging from algebra and calculus to combinatorics and proof-based reasoning. Your core task is to compare two or more responses side by side, rank them by correctness and clarity, and flag specific reasoning errors (wrong setup, arithmetic mistakes, skipped logical steps) using a structured rubric. You won't just say "this one is better" — you'll annotate exactly where and why.
The workflow runs inside a browser-based annotation tool. Each task presents a problem statement and two to four model responses. You'll read each solution, verify the math independently, score it across dimensions like factual accuracy, step completeness, and explanation quality, then submit a ranked preference with written rationale. Tasks average 8–15 minutes each depending on problem complexity. You'll work asynchronously across flexible hours with a weekly throughput target.
Strong candidates hold at least an undergraduate background in math, engineering, physics, or a related quantitative field. You should be comfortable doing manual verification — not just pattern-matching for "looks right." Familiarity with LaTeX notation is a plus since many prompts and responses are rendered that way. You won't need to write code, but you will need to show your own working when the rubric asks for it.
Requirements
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
Why this role
You can do this Math Reasoning RLHF Annotator role from home, and it pays $35-55/hr.
Talent pool
We're light on Mathematics candidates
We've tracked 1,024 Mathematics listings and have few candidates to put forward for them. Set up a profile and we'll consider you for roles like this one.
Set up your profileSkills and categories
More jobs in these fields:
Related jobs
Verified reviews
Community reviews
Leave your review
Common questions
What makes this one of Claru's higher-paying roles?
Claru bands its desk-based work by how much judgment a task needs. This listing sits in the top band at $35-$55/hr, alongside its RLHF evaluation, medical and 3D vision annotation and red-teaming roles, all of which expect graduate-level or professional depth in the subject and the ability to justify a score in writing. Its entry-tier text labeling sits at $20-$35/hr for comparison.
Is Claru desk work a steady queue or does it arrive in batches?
It comes in batches. You pick up a batch when you want, finish it and submit it, with no meetings. A new batch may not be waiting when you finish one, so plan for it as project income.
Does Claru publish the rate before I apply?
Yes. Every listing on claru.ai/jobs shows its hourly band on the card and again on the role page, so you can compare a $20-$35/hr labeling role against a $55-$100/hr evaluation role without creating an account first.
How does Claru measure quality on this kind of work?
Through agreement scoring and review. Its evaluation roles set a target for how closely your scores track other annotators, and disagreements with reviewers are resolved in an async comment thread you are expected to answer within a day. Steady, strong scores open the senior and lead tracks Claru mentions in its listings.
What does task-based AI training work look like?
Short, hands-on tasks such as recording videos, sorting images, rating AI answers or checking data. Most take 5 to 60 minutes each.
Can I choose my own hours?
Usually, yes. You log in when you want, pick up a task, finish it and submit it, with no meetings. Other people work from the same pool of tasks, so some days there may be no work until more is added.
What does Mathematics work look like for a Math Reasoning RLHF Annotator?
You check AI answers to Mathematics questions, correct their errors and write expert reasoning. As a Math Reasoning RLHF Annotator, you're hired for that judgment, so hands-on Mathematics experience matters.
What specific skills does this listing call for?
Data Annotation is named directly in the listing. If you don't have hands-on experience with this, expect the screening to test for it.
How much does this specific role pay?
This listing is posted at $35-55/hr, an hourly rate. Where you land in the range depends on your background and the assessment. Pay can change after we check the listing, so confirm the rate on the platform's application page.
What happens when I click Apply on this listing?
Apply opens Claru's site, where you create an account and follow its sign-up steps.
Who is behind Claru?
Claru is the contributor-facing brand of Reka AI, which collects human data for frontier AI labs across text, vision, video and robotics. Its board splits into regional video capture work and desk-based annotation and evaluation, and the apply link on this page is an affiliate link that does not change your pay or what you are offered.