Software Engineers: Paid Code Review for AI Agent Evaluation
Terac • United States, Canada
Education
Not stated
Type
Hourly
Pay
$65/hr
The rate in the listing.
Last checked
6d ago
Checked
About this role
From the Terac listing
What We're Researching
We're running a paid study on the coding environments and programming tasks used to benchmark artificial intelligence agents. Creating robust evaluation harnesses ensures that AI models are tested against realistic software engineering scenarios. This work directly feeds into improving how autonomous agents handle complex coding objectives.
How It Works
During this remote session, you will review a series of coding tasks and their corresponding evaluation harnesses. You will assess whether the programming challenges accurately reflect real-world software engineering problems. We will ask you to verify the logic, test cases, and overall structure of the environments provided. Your technical feedback will be captured through a guided conversation and screen-sharing exercises.
Who This Is For
We are looking for practicing software engineers with strong backgrounds in building and testing complex systems. Candidates should have direct experience writing test suites, evaluation harnesses, or comprehensive code reviews. We welcome backend engineers, full-stack developers, machine learning engineers, and software architects.
Why this role
This Software Engineers: Paid Code Review for AI Agent Evaluation position pays $65/hr. You need solid STEM knowledge, and you learn the AI training steps on the job.
Talent pool
We're light on STEM candidates
We've tracked 1,025 STEM listings and have few candidates to put forward for them. Set up a profile and we'll consider you for roles like this one.
Set up your profileSkills and categories
More jobs in these fields:
Related jobs
Offensive Cybersecurity Engineers: Build RL Environments for AI Evaluation
Terac • STEM
$150 /hr
Circuit Design Engineers: Paid Technical Project on SPICE Simulation
Terac • STEM
$158 /hr
Hardware Engineers: RTL Implementation and Evaluation Workflows
Terac • STEM
$147 /hr
Crash Simulation Engineers: Vehicle Crash Simulation Workflows
Terac • STEM
$126 /hr
Verified reviews
Community reviews
Leave your review
Common questions
Is Terac legitimate?
Yes. Terac is a funded US marketplace whose clients are AI labs and market-research firms. It checks your identity and professional background before it matches you to paid work.
How does Terac decide who gets matched to this listing?
You do a short AI interview, an ID check and a test in your field, once. Terac then matches you to paid studies that fit your profile, and pays you after your submission is checked against the requirements.
Is this kind of AI-training work on Terac steady, or does it come and go?
It comes and goes. Terac opens listings like this when an AI lab asks for a batch of work, such as sorting data, writing coding tasks or creating expert problems, and closes them when the batch is done. Plan for it as gig income you qualify for each time.
Why does pay vary so much across Terac's AI-training listings?
Pay follows the expertise a task needs. General labeling pays a few dollars an hour, and work that needs a passed screening in your field, such as software engineering or STEM problems, can pay over $100 a task. Check the rate on this listing.
Do I need a PhD for research-level AI training roles?
The best-paid roles usually expect a PhD or current enrollment. The domain assessment decides, though, and if you can solve the problems the degree matters less.
Is research-level AI training steady work?
Usually not. Work comes in projects, such as training a model on quantum mechanics, that can last a few weeks. Plan for it like a short fellowship.
What does STEM work look like for a Software Engineers: Paid Code Review for AI Agent Evaluation?
You check AI answers to STEM questions, correct their errors and write expert reasoning. As a Software Engineers: Paid Code Review for AI Agent Evaluation, you're hired for that judgment, so hands-on STEM experience matters.
What specific skills does this listing call for?
Coding is named directly in the listing. If you don't have hands-on experience with this, expect the screening to test for it.
How much does this specific role pay?
This listing is posted at $65/hr, an hourly rate. Pay can change after we check the listing, so confirm the rate on the platform's application page.
What happens when I click Apply on this listing?
Apply opens Terac's site, where you create an account and follow its sign-up steps.
Can I apply from outside the United States or Canada?
This role is open only to people based in the United States and Canada. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply, since they can differ by country.