Full-Stack Code Output Evaluator
Claru • Remote
Education
Not stated
Type
Hourly
Pay
$55-100/hr
Your rate depends on your experience and the task.
Last checked
5d ago
Checked
About this role
From the Claru listing
You'll review AI-generated code across the full web stack — JavaScript, TypeScript, Java backend services, and Node.js APIs — assessing correctness, security, maintainability, and adherence to the task specification. For each task, you receive a prompt that was given to a code-generating model and the code it produced. You run the code (in a provided sandbox or your local environment), verify it works as specified, and score it on multiple rubric dimensions. If the code is broken or insecure, you document exactly why, with line-level references.
Workflows include side-by-side comparison tasks (picking the better of two model outputs with written justification), single-output correctness reviews (does this code do what the prompt asked?), and security-flag tasks (does this output introduce SQL injection, XSS, or insecure dependency patterns?). You'll also encounter backend architecture tasks where you evaluate whether a Node.js or Java service is structured sensibly for the stated use case — not just whether it runs, but whether a senior engineer would accept it in a real PR. Some tasks use Eclipse-based Java projects; comfort navigating that toolchain is expected.
You should have at least 4 years of professional full-stack development experience, with production-level fluency in JavaScript/TypeScript and Java. You don't need to write new features — your job is to read and judge code quickly and accurately. Annotators who've done code review as part of a senior or lead engineering role tend to calibrate well for this work.
Requirements
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- Bachelor's degree or equivalent professional experience
- Demonstrated expertise in Software Engineering
Interview prep
This listing mentions these tools. Brush up before a technical screen:
Why this role
At $55-100/hr, this remote Full-Stack Code Output Evaluator role doesn't ask you to move or come into an office.
Skills and categories
More jobs in these fields:
Related jobs
Verified reviews
Community reviews
Leave your review
Common questions
What makes this one of Claru's higher-paying roles?
Claru bands its desk-based work by how much judgment a task needs. This listing sits in the top band at $55-$100/hr, alongside its RLHF evaluation, medical and 3D vision annotation and red-teaming roles, all of which expect graduate-level or professional depth in the subject and the ability to justify a score in writing. Its entry-tier text labeling sits at $20-$35/hr for comparison.
Is Claru desk work a steady queue or does it arrive in batches?
It comes in batches. You pick up a batch when you want, finish it and submit it, with no meetings. A new batch may not be waiting when you finish one, so plan for it as project income.
Do I need to install anything to do the work?
No. Claru's annotation and evaluation work runs in browser-based tools, including third-party platforms such as Segments.ai for 3D work and DICOM viewers for medical imaging, so there is no local install to maintain.
Does Claru publish the rate before I apply?
Yes. Every listing on claru.ai/jobs shows its hourly band on the card and again on the role page, so you can compare a $20-$35/hr labeling role against a $55-$100/hr evaluation role without creating an account first.
What does task-based AI training work look like?
Short, hands-on tasks such as recording videos, sorting images, rating AI answers or checking data. Most take 5 to 60 minutes each.
Can I choose my own hours?
Usually, yes. You log in when you want, pick up a task, finish it and submit it, with no meetings. Other people work from the same pool of tasks, so some days there may be no work until more is added.
What does Software Engineering work look like for a Full-Stack Code Output Evaluator?
You check AI answers to Software Engineering questions, correct their errors and write expert reasoning. As a Full-Stack Code Output Evaluator, you're hired for that judgment, so hands-on Software Engineering experience matters.
What specific skills does this listing call for?
Coding, Node.js, and TypeScript are named directly in the listing. If you don't have hands-on experience with these, expect the screening to test for them.
How much does this specific role pay?
This listing is posted at $55-100/hr, an hourly rate. Where you land in the range depends on your background and the assessment. Pay can change after we check the listing, so confirm the rate on the platform's application page.
What happens when I click Apply on this listing?
Apply opens Claru's site, where you create an account and follow its sign-up steps.
Who is behind Claru?
Claru is the contributor-facing brand of Reka AI, which collects human data for frontier AI labs across text, vision, video and robotics. Its board splits into regional video capture work and desk-based annotation and evaluation, and the apply link on this page is an affiliate link that does not change your pay or what you are offered.