Python Code Generation Reviewer
Claru • Remote
Education
Not stated
Type
Hourly
Pay
$35-55/hr
Your rate depends on your experience and the task.
Last checked
5d ago
Checked
About this role
From the Claru listing
Your primary work is reviewing Python code produced by language models in response to natural-language coding prompts. For each task you'll receive the original prompt, one or more model-generated code snippets, and a rubric covering correctness, efficiency, readability, and edge-case handling. You'll run or mentally trace the code, identify bugs or logic errors, and submit structured feedback — including a preference ranking if multiple variants are presented and inline comments where issues occur.
Tasks arrive through a web-based review interface. You'll encounter a mix of prompt types: algorithmic challenges (sorting, graph traversal, dynamic programming), data manipulation with pandas or NumPy, API integration stubs, and general scripting tasks. Some sessions focus on ranking two completions; others ask you to rewrite a flawed snippet to a higher standard. You'll be working asynchronously and should expect 6–10 tasks per hour depending on code length and complexity.
Ideal candidates have 2+ years of Python development experience and are comfortable quickly reading unfamiliar code without an IDE scaffolding everything for you. You don't need deep ML knowledge — the job is software quality review, not model development. Familiarity with common Python anti-patterns, time complexity basics, and standard library modules (itertools, collections, os, etc.) will serve you well.
Requirements
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
Interview prep
This listing mentions this tool. Brush up before a technical screen:
Why this role
This remote Python Code Generation Reviewer role pays $35-55/hr, and you work from home.
Skills and categories
More jobs in these fields:
Related jobs
Verified reviews
Community reviews
Leave your review
Common questions
What makes this one of Claru's higher-paying roles?
Claru bands its desk-based work by how much judgment a task needs. This listing sits in the top band at $35-$55/hr, alongside its RLHF evaluation, medical and 3D vision annotation and red-teaming roles, all of which expect graduate-level or professional depth in the subject and the ability to justify a score in writing. Its entry-tier text labeling sits at $20-$35/hr for comparison.
Is Claru desk work a steady queue or does it arrive in batches?
It comes in batches. You pick up a batch when you want, finish it and submit it, with no meetings. A new batch may not be waiting when you finish one, so plan for it as project income.
Does Claru publish the rate before I apply?
Yes. Every listing on claru.ai/jobs shows its hourly band on the card and again on the role page, so you can compare a $20-$35/hr labeling role against a $55-$100/hr evaluation role without creating an account first.
How does Claru measure quality on this kind of work?
Through agreement scoring and review. Its evaluation roles set a target for how closely your scores track other annotators, and disagreements with reviewers are resolved in an async comment thread you are expected to answer within a day. Steady, strong scores open the senior and lead tracks Claru mentions in its listings.
Do task-based AI training roles require an interview?
Most use an online assessment or a test task instead of a live interview. When the listing says which, it's in the role details on this listing.
What does task-based AI training work look like?
Short, hands-on tasks such as recording videos, sorting images, rating AI answers or checking data. Most take 5 to 60 minutes each.
What does Software Engineering work look like for a Python Code Generation Reviewer?
You check AI answers to Software Engineering questions, correct their errors and write expert reasoning. As a Python Code Generation Reviewer, you're hired for that judgment, so hands-on Software Engineering experience matters.
What specific skills does this listing call for?
Coding and Python are named directly in the listing. If you don't have hands-on experience with these, expect the screening to test for them.
How much does this specific role pay?
This listing is posted at $35-55/hr, an hourly rate. Where you land in the range depends on your background and the assessment. Pay can change after we check the listing, so confirm the rate on the platform's application page.
What happens when I click Apply on this listing?
Apply opens Claru's site, where you create an account and follow its sign-up steps.
Who is behind Claru?
Claru is the contributor-facing brand of Reka AI, which collects human data for frontier AI labs across text, vision, video and robotics. Its board splits into regional video capture work and desk-based annotation and evaluation, and the apply link on this page is an affiliate link that does not change your pay or what you are offered.