Skip to content
aitrainer.work - AI Training Jobs Platform

Agentic AI and RL Environment Jobs: Build and Grade the Tasks Agents Learn From

Paid work on AI agents, the models that run commands, click through software and call tools instead of only writing text. Three kinds of role: environment builders write the sandboxed tasks and graders agents train on, trajectory specialists record how a competent person completes them, and agent evaluators grade what the agent did, step by step. All three are remote contracts worked from home. Most roles here pay $65 to $85/hr.

70 open jobs
Typical pay
$80/hr
Most roles pay
$65 to $85/hr
Based on
50 posted rates
Updated
November 16, 2026

About Agentic Tasks & RL Environments work

Agentic work trains models to act, so the data is tasks, demonstrations and graded runs

An agent is a model that does things rather than describing them: it runs a command, clicks through a settings page, calls an API, edits a file, and checks its own result. Training one needs three kinds of human work, and the listings here cover all three.

Environment building means writing the task an agent will practice on: a starting state (a repository with a bug, a spreadsheet with errors, a half-finished marketing brief), a goal, the actions available, and a grader that scores the attempt automatically. Listings say "RL environment builder", "scenario designer" or "benchmarks and RL environments". The RL stands for reinforcement learning, the training loop that rewards the agent when the grader says it succeeded.

Trajectory work means doing the task yourself inside the environment while every step is recorded, so the model learns from a competent demonstration. Titles include "trajectory specialist", "computer use annotator" and "agent trace collection". It feels like being screen-recorded doing your normal job, with a requirement to narrate why.

Agent evaluation means reading what an agent did, step by step, and grading it: did it take sane actions, did it finish, did it cheat the grader, would a senior colleague have accepted the result. Titles say "agent evaluation analyst", "agentic workflow reviewer" or "task auditor". Of the three, this is the closest to RLHF evaluation, with the difference that you are judging a sequence of actions, not a paragraph.

One example task, start to finish

This is our own example, not a task from any platform. You are asked to build an environment for an accounting agent.

You write the starting state: a 40-row expense ledger and a folder of receipts, where three rows disagree with their receipt (a transposed amount, a duplicated entry, a receipt with no row). The goal: reconcile the ledger and file a correction note. The grader you write checks that exactly those three rows were fixed and that the note names each one, and it penalizes any edit to a row that was already correct. Then you record a reference run of yourself doing it.

Two agent runs come back for review. Run A changes all 40 amounts to match the receipt totals, which makes the ledger sum correct and would pass a grader that only checked the total. Run B finds the transposed amount and the duplicate, misses the missing row, and writes an accurate note. Run A is the one that matters: it found a hole in your grader, which is the failure environment builders are paid to prevent. You tighten the grader, score B as partial with the miss named, and flag A as reward hacking so the lab can use it as a regression test.

In trajectory roles you would be the reference run: reconciling the ledger yourself in the sandbox, with each click and keystroke logged, and a short note at each decision point. The logs are usually JSON, which is why several listings ask for comfort with structured data; the Academy module Markdown and JSON Formatting covers what reviewers check.

It suits engineers and people who are fluent in the software of their own trade

Software engineers are the largest group: listings ask for a language (Python most often, then Go, Rust and TypeScript), experience working with coding agents, and the ability to write a test an agent cannot game. Benchmarks like SWE-bench and terminal-bench appear in titles because labs want people who can write tasks in that shape.

The second group is professionals who live in a specific tool: accountants in QuickBooks, marketers in a CRM and an ad manager, operations people in ticketing systems. Those listings want you to build or demonstrate the workflow an agent should learn, and they do not ask for code. Most of them are posted by one platform at a time in batches, so the list below can swing from twenty such roles to none in a month.

It does not suit people who dislike adversarial thinking. Every grader you write will be attacked by a model that is better at finding loopholes than most humans, and the job is to assume that and close them. If you prefer to judge finished text, RLHF evaluation is the better fit.

Screening is a technical interview for engineers and a workflow walkthrough for everyone else

Engineering roles run a live coding or debugging round, sometimes automated, and often ask to see public work: one listing here recruits by GitHub contribution history. Expect to explain how you would write a grader for a task and how an agent might game it. The Academy module Live Code Review and Debugging Interviews is built for this round, and Python for AI Training covers the language most listings name.

Domain roles screen with a short conversational interview and a sample task: build one scenario in your tool, or walk through how you would, with the steps written out. Where listings here state a screening step at all, it is an interview; most say nothing, so read each posting.

Pay comes from the listings above, and most of them post one engineering rate

These figures come from the rates the open listings state, and they update as listings change. How we work out pay.

Most roles here pay $65 to $85/hr.

The range is narrow because most listings here post one rate for an engineering level, and a platform often posts the same rate across a batch of roles. Trajectory and domain-workflow roles tend to sit below the engineering rate; benchmark and environment design roles at or above it.

How to start this week

  1. Pick the track that matches what you already do. Engineers: environment building and agentic coding. Tool-fluent professionals: trajectory and workflow roles. Careful readers with some technical comfort: agent evaluation.
  2. Build one environment on your own before applying. A task with a starting state, a goal, a grader and a reference run, in a public repository, is the strongest application material the listings here respond to. Keep it small and make the grader hard to game.
  3. Prepare for the adversarial question. "How would an agent cheat this?" comes up in interviews and in the work. Practice answering it for your own task.
  4. Apply to the listings sorted by newest. Batches here open and close quickly; a role that is three weeks old is often filled.
  5. Keep your JSON and Markdown clean. Trajectory logs and task specs are reviewed as structured data, and formatting errors are the fastest way to fail a trial batch.

Adjacent kinds of work: RLHF evaluation grades what a model said, red teaming tries to make it misbehave, and the software engineering page lists code review roles that do not involve agents.

Type:
Popular:

70 jobs

Page 1 of 3

Ethos expert network platform

RL Engineer Expert

$100

/hr

Ethos•171d ago
STEMPythonPyTorch
New job posted today
Terac paid research studies platform

Offensive Cybersecurity Engineers: Build RL Environments for AI Evaluation

$150

/hr

Terac•2d ago
STEMAI Training
Turing remote developer platform

Agentic Life Science Expert

$30-70

/hr · our estimate

Turing•PhD•18d ago
ExpertAI Training
Turing remote developer platform

Business Analyst (Computer Use Agent) - II

$15-30

/hr · our estimate

Turing•Bachelor's•18d ago
BusinessEnglish
Newsletter subscription
AI Training Jobs

New AI training jobs every Tuesday

Trending jobs, new guides and pay data from listings, in one weekly email.

500+ subscribers

Unsubscribe anytime.

Turing remote developer platform

Business Analyst (Computer Use Agent)

$15-30

/hr · our estimate

Turing•Bachelor's•18d ago
BusinessEnglish
micro1 AI training platform

AI Agent Tester - Real-World Tasks

$25-45

/hr

micro1•Bachelor's•22d ago
AnyoneAI expert human data platform

Senior Software Engineer – Open Source & SWE-Bench Evaluation

$65

/hr equivalent

AnyoneAI•34d ago
micro1 AI training platform

AI Agent Evaluator

$25-45

/hr

micro1•Bachelor's•37d ago
Mercor AI hiring platform

Task Writer: Project Agentic-MME

$60

/hr

Mercor•44d ago
WritingAI Training
Terac paid research studies platform

Software Engineers: Paid Code Review for AI Agent Evaluation

$65

/hr

Terac•44d ago
Innodata AI data engineering company

Engagement Manager, Agentic AI Workflow Evaluations

$75-85

/hr

Innodata•58d ago
BusinessAI Training
Innodata AI data engineering company

AI Agentic Workflow Reviewer

$50-55

/hr

Innodata•57d ago
Meridial expert contractor network, by Invisible Technologies

SWE-Bench AI Task Auditor - Freelance AI Trainer Project

$60

/hr

Meridial•63d ago
Turing remote developer platform

Tech Lead - Agent Development

$15-35

/hr · our estimate

Turing•67d ago
Turing remote developer platform

LLM Trainer – Terminal-Bench (Python & Linux Systems)

$12-30

/hr · our estimate

Turing•67d ago
Turing remote developer platform

OSWorld GUI Data Annotator (Ubuntu Desktop)

$15-30

/hr · our estimate

Turing•67d ago
Turing remote developer platform

Agentic Tasker (Frontier STEM)

$15-30

/hr · our estimate

Turing•Bachelor's•68d ago
Turing remote developer platform

Software / Platform / Data Engineer — Agent Trace Collection

$25-55

/hr · our estimate

Turing•Bachelor's•70d ago
Terac paid research studies platform

Machine Learning Engineers: Scenario Building for Reinforcement Learning

$90

/hr

Terac•62d ago
Data ScienceAI Training
Mercor AI hiring platform

SWE-Bench Task Auditor

$70-90

/hr

Mercor•76d ago
AccountingCodingDjangoJava
Mercor AI hiring platform

Marketing Expert — Brand Marketing (AI Agent Environments)

$60-100

/hr

Mercor•82d ago
Mercor AI hiring platform

Marketing Expert — Field Marketing (AI Agent Environments)

$60-100

/hr

Mercor•82d ago
Mercor AI hiring platform

Marketing Expert — Marketing Operations (AI Agent Environments)

$60-100

/hr

Mercor•82d ago
Mercor AI hiring platform

Marketing Expert — Lifecycle (AI Agent Environments)

$60-100

/hr

Mercor•82d ago
Mercor AI hiring platform

Marketing Expert — PR & Communications (AI Agent Environments)

$60-100

/hr

Mercor•Bachelor's•82d ago
Mercor AI hiring platform

Marketing Expert — Creator & Influencer (AI Agent Environments)

$60-100

/hr

Mercor•Master's•82d ago
Mercor AI hiring platform

Marketing Expert — Social Media (AI Agent Environments)

$60-100

/hr

Mercor•82d ago
Mercor AI hiring platform

Marketing Expert — Content Marketing (AI Agent Environments)

$60-100

/hr

Mercor•82d ago
Page 1 of 3 Next →

Get new Agentic Tasks & RL Environments jobs as they open

One browser alert a day with new roles, Agentic Tasks & RL Environments first. You don't need an email.

Or follow new roles in Telegram: @aitrainerwork

Browse by category or skill

Similar to: Offensive Cybersecurity Engineers: Build RL Environments for AI Evaluation

Similar to: Business Analyst (Computer Use Agent) - II

Similar to: Agentic Life Science Expert

Common questions

What is an RL environment job?

An RL environment job pays you to build the tasks an AI agent practices on: a starting state, a goal, the actions allowed, and a grader that scores each attempt automatically. RL stands for reinforcement learning, the loop that rewards the agent when the grader says it succeeded. Most roles are remote hourly contracts; some are paid per environment.

Do I need to know reinforcement learning to do agentic AI work?

No reinforcement learning knowledge is needed. The training algorithm is the lab's job. Listings ask you to design a task with a clear success condition, write a grader that cannot be gamed, and, for trajectory roles, do the task competently while being recorded.

What is an agent trajectory or trace?

A trajectory is the full record of one attempt at a task: every action the agent or human demonstrator took, what it saw after each action, and the final result. Trajectory specialists produce reference runs; agent evaluators grade recorded runs step by step.

What is reward hacking and why do listings mention it?

Reward hacking is an agent finding a way to make the grader report success without doing the task, like editing a test instead of fixing the bug. Environment builders are paid largely to prevent it, and agent evaluators are paid to catch it in recorded runs.

How much do agentic AI and RL environment jobs pay?

Engineering roles set the typical rate, with trajectory and domain-workflow roles below it and environment design at or above it. Most agentic and RL environment roles pay $65 to $85/hr.

Can I do RL environment work without being a software engineer?

Yes, for a subset of roles. Platforms post batches of roles for professionals fluent in a specific tool, such as accounting software, marketing systems or operations platforms, to build or demonstrate workflows. Those roles need no code, and they open and fill quickly, so set a job alert.

Which platforms post agentic and RL environment work?

The mix changes month to month, because labs commission this work in projects of a few weeks, and a platform that posts twenty environment roles in one batch may post none the next. The platform filter on the jobs list shows which platforms have open roles today.

How many Agentic Tasks & RL Environments AI training jobs are open right now?

There are 70 open listings, from 10 platforms: Mercor (31), Turing (16), Mindrift (6), Terac (5) and micro1 (4). The newest one was added 2 days ago. The count changes as platforms post and close roles.

Other kinds of AI training work

See all categories