Database Systems Evaluation Expert
Mercor • Remote
Education
PhD
Type
Per task
Pay
$2,200 per task
A fixed price for each task.
Last checked
1d ago
Checked
Before you apply
- Who can apply
- You need a PhD.
Marked as applied on .
Only apply if this role fits your skills and interests.
About this role
From the Mercor listing
Applications close Friday, October 16, 2026 at 12:00 p.m. Pacific. We are selecting the first three applicants who qualify for the initial pilot.
About the work
Build real-world tasks that test how well AI agents handle database engineering. Depending on your specialty, your task may cover database-engine implementation, production diagnosis, or application migration.
Each task should include a clear problem statement, a reproducible repository or environment, a working reference solution, tests, and grading criteria that distinguish a robust engineering solution from one that only appears correct.
What you'll do
Design one challenging, self-contained database engineering task.
Build checks for correctness, failure handling, concurrency, retries, and regressions where relevant.
Evaluate performance measures such as latency, throughput, and memory use.
Write clear grading criteria for engineering judgment.
Work with technical reviewers to refine and validate the task.
Who we're looking for
At least five years of hands-on database-engine internals experience, or a database-systems PhD.
Deep experience with storage engines, query execution, optimization, transactions, replication, or related low-latency systems.
Strong implementation skills and clear explanations of correctness and performance tradeoffs.
Experience with Go is preferred.
DBA, SQL analytics, ETL, or application-only database experience does not qualify on its own. You do not need to specialize in every task area.
Application process
Complete a self-paced technical assessment with written responses and a coding exercise. You control when to advance between sections. (~35 min)
Use a laptop or desktop with a camera, microphone, and entire-screen sharing. Have your own editor and terminal ready, along with Python 3.8+ and a compiler for C, C++, Rust, Go, or Java. The assessment includes a starter kit and public tests. Complete the assessment independently, without outside AI assistance.
Please apply as soon as possible. We will select the first three qualifying applicants. If the pilot fills, completed assessments may be considered for future work if the project expands.
Paid task after selection
Selected experts will complete one task, with approximately 25 hours of work, followed by technical review and feedback.
Task deadline: Friday, October 30, 2026.
Requirements
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- PhD's degree or equivalent professional experience
- Demonstrated expertise in Generalist
How long hiring takes
On the platforms we refer people to, half of hires came within about 20 days of applying. Time from applying to hire:
Talent pool members
When your profile is a strong match, we can put you forward to Mercor. Set up your profile first if you haven't.
Set up your profile →Typical contract length
Across 10 Mercor Generalist listings we've tracked, contracts typically run about 6.8 weeks. Length varies by project.
Why this role
At $2,200 per task, this Database Systems Evaluation Expert role asks you to check AI answers in Generalist the way a colleague in your field would.
Skills and categories
More jobs in these fields:
Related jobs
Verified reviews
Community reviews
Leave your review
Common questions
Does it cost money to apply to Mercor?
No, applying to and joining Mercor is free. Mercor charges the client a fee on top of your rate. If anyone asks you to pay to join, treat it as a scam.
Is Mercor for freelancers or full-time contractors?
Mercor places you with one client for a set contract, such as 'Python Tutor for 3 months'. Most roles are steady contract work rather than one-off tasks.
Is AI training work the same as traditional consulting?
It's closer to teaching. You grade the AI's logic, correct its mistakes and write the expert reasoning it lacks, instead of producing work for a client.
Why do expert AI training roles pay well?
The model already knows the basics. It needs help with hard edge cases, the judgment calls a senior professional in the field gets right.
What does Generalist work look like for a Database Systems Evaluation Expert?
You check AI answers to Generalist questions, correct their errors and write expert reasoning. As a Database Systems Evaluation Expert, you're hired for that judgment, so hands-on Generalist experience matters.
How much does this specific role pay?
This listing is posted at $2,200 per task, a per-task rate. Pay can change after we check the listing, so confirm the rate on the platform's application page.
How does per-task pay translate to an hourly rate?
It depends on how fast you work. Each task has a price and an estimated time. If a task is estimated at 20 minutes and pays $8, that is $24/hr if you take 20 minutes and $12/hr if you take 40. Time your first few tasks to see what you earn per hour.
What happens when I click Apply on this listing?
Apply opens Mercor's site, where you create an account and follow its sign-up steps.
Is a PhD required?
For this role, yes, or similar professional depth, and the assessment checks it. PhD candidates and people with published research have qualified without the degree.
How soon will I start working after applying to Mercor?
Usually after a few weeks. Applying puts you in Mercor's pool of candidates, and you start once a client, such as an AI lab, picks your profile.