Skip to content
aitrainer.work - AI Training Jobs Platform
STEM Terac

Software Engineers: Paid Code Review for AI Agent Evaluation

Terac • United States, Canada

Education

Not stated

Type

Hourly

Pay

$65/hr

The rate in the listing.

Last checked

6d ago

Checked

Send this job to a friend

New roles in Telegram: @aitrainerwork

About this role

From the Terac listing

What We're Researching

We're running a paid study on the coding environments and programming tasks used to benchmark artificial intelligence agents. Creating robust evaluation harnesses ensures that AI models are tested against realistic software engineering scenarios. This work directly feeds into improving how autonomous agents handle complex coding objectives.

How It Works

During this remote session, you will review a series of coding tasks and their corresponding evaluation harnesses. You will assess whether the programming challenges accurately reflect real-world software engineering problems. We will ask you to verify the logic, test cases, and overall structure of the environments provided. Your technical feedback will be captured through a guided conversation and screen-sharing exercises.

Who This Is For

We are looking for practicing software engineers with strong backgrounds in building and testing complex systems. Candidates should have direct experience writing test suites, evaluation harnesses, or comprehensive code reviews. We welcome backend engineers, full-stack developers, machine learning engineers, and software architects.

Why this role

This Software Engineers: Paid Code Review for AI Agent Evaluation position pays $65/hr. You need solid STEM knowledge, and you learn the AI training steps on the job.

Talent pool

We're light on STEM candidates

We've tracked 1,025 STEM listings and have few candidates to put forward for them. Set up a profile and we'll consider you for roles like this one.

Set up your profile

Skills and categories

More jobs in these fields:

Related jobs

Verified reviews

Loading reviews…

Community reviews

Loading reviews…
💬

Share your experience with Terac

Sign in to leave a review

Common questions

Is Terac legitimate?

Yes. Terac is a funded US marketplace whose clients are AI labs and market-research firms. It checks your identity and professional background before it matches you to paid work.

How does Terac decide who gets matched to this listing?

You do a short AI interview, an ID check and a test in your field, once. Terac then matches you to paid studies that fit your profile, and pays you after your submission is checked against the requirements.

Is this kind of AI-training work on Terac steady, or does it come and go?

It comes and goes. Terac opens listings like this when an AI lab asks for a batch of work, such as sorting data, writing coding tasks or creating expert problems, and closes them when the batch is done. Plan for it as gig income you qualify for each time.

Why does pay vary so much across Terac's AI-training listings?

Pay follows the expertise a task needs. General labeling pays a few dollars an hour, and work that needs a passed screening in your field, such as software engineering or STEM problems, can pay over $100 a task. Check the rate on this listing.

Do I need a PhD for research-level AI training roles?

The best-paid roles usually expect a PhD or current enrollment. The domain assessment decides, though, and if you can solve the problems the degree matters less.

Is research-level AI training steady work?

Usually not. Work comes in projects, such as training a model on quantum mechanics, that can last a few weeks. Plan for it like a short fellowship.

What does STEM work look like for a Software Engineers: Paid Code Review for AI Agent Evaluation?

You check AI answers to STEM questions, correct their errors and write expert reasoning. As a Software Engineers: Paid Code Review for AI Agent Evaluation, you're hired for that judgment, so hands-on STEM experience matters.

What specific skills does this listing call for?

Coding is named directly in the listing. If you don't have hands-on experience with this, expect the screening to test for it.

How much does this specific role pay?

This listing is posted at $65/hr, an hourly rate. Pay can change after we check the listing, so confirm the rate on the platform's application page.

What happens when I click Apply on this listing?

Apply opens Terac's site, where you create an account and follow its sign-up steps.

Can I apply from outside the United States or Canada?

This role is open only to people based in the United States and Canada. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply, since they can differ by country.