SWE Coding Benchmarks & RL Environments
Terac • Remote, Canada, United States
Education
Not stated
Type
Hourly
Pay
$75/hr
The rate in the listing.
Last checked
3d ago
Checked
About this role
From the Terac listing
Remote · Contract · $45-75/hr, paid weekly · 10–20+ hrs/week
We build coding tasks used to train and evaluate frontier AI coding agents. We're looking for experienced software engineers to design them.
What the work involves
- Writing realistic engineering tasks on full-stack web apps: the kind of problem a real team has in its backlog, on codebases that grow as each task builds on the last.
- Writing the tests that decide whether a solution is correct.
- Going beyond the UI: new services and APIs, a backend in another language (Go, Rust, Java), gRPC, rate limiting — drawing on systems you've actually built.
- Sharing what you've seen work in other projects and flagging what should change in ours.
The apps are TypeScript (React, Node, SQLite, Playwright). Use AI tools as much as you like to write code and tests.
What we're looking for
- Solid professional software engineering experience, backend and frontend.
- You've built and debugged real systems, and you care about testing them well.
- Clear written communication, and comfort working independently from written docs.
- 10–20+ hours a week, starting soon.
How it works
A short screener, a brief AI interview, and a paid work trial on the codebase you'd keep working on. US and Canada preferred for timezone overlap; exceptional candidates elsewhere are welcome. LinkedIn and GitHub required.
Interview prep
This listing mentions these tools. Brush up before a technical screen:
Why this role
At $75/hr, this remote SWE Coding Benchmarks & RL Environments role doesn't ask you to move or come into an office.
Skills and categories
More jobs in these fields:
Related jobs
Legal Professionals: Paid Engagement on Specialized Workflows
Terac • Software Engineering
$112 /hr
Software Engineering - Research & Evaluation Studies
Terac • Software Engineering
$250 per task
Insurance Distribution Market Expert – Paid Research Interview
Mercor • Software Engineering
$555 per task
Independent Insurance Agency Owner / Principal – Paid Research Interview
Mercor • Software Engineering
$450 per task
Verified reviews
Community reviews
Leave your review
Common questions
Is Terac legitimate?
Yes. Terac is a funded US marketplace whose clients are AI labs and market-research firms. It checks your identity and professional background before it matches you to paid work.
How does Terac decide who gets matched to this listing?
You do a short AI interview, an ID check and a test in your field, once. Terac then matches you to paid studies that fit your profile, and pays you after your submission is checked against the requirements.
Is this kind of AI-training work on Terac steady, or does it come and go?
It comes and goes. Terac opens listings like this when an AI lab asks for a batch of work, such as sorting data, writing coding tasks or creating expert problems, and closes them when the batch is done. Plan for it as gig income you qualify for each time.
Why does pay vary so much across Terac's AI-training listings?
Pay follows the expertise a task needs. General labeling pays a few dollars an hour, and work that needs a passed screening in your field, such as software engineering or STEM problems, can pay over $100 a task. Check the rate on this listing.
Can I choose my own hours?
Usually, yes. You log in when you want, pick up a task, finish it and submit it, with no meetings. Other people work from the same pool of tasks, so some days there may be no work until more is added.
What does Software Engineering work look like for a SWE Coding Benchmarks & RL Environments?
You check AI answers to Software Engineering questions, correct their errors and write expert reasoning. As a SWE Coding Benchmarks & RL Environments, you're hired for that judgment, so hands-on Software Engineering experience matters.
What specific skills does this listing call for?
Coding, TypeScript, and Java are named directly in the listing. If you don't have hands-on experience with these, expect the screening to test for them.
How much does this specific role pay?
This listing is posted at $75/hr, an hourly rate. Pay can change after we check the listing, so confirm the rate on the platform's application page.
What happens when I click Apply on this listing?
Apply opens Terac's site, where you create an account and follow its sign-up steps.
Can I apply from outside Canada or the United States?
This role is open only to people based in Canada and the United States. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply, since they can differ by country.