Skip to content
aitrainer.work - AI Training Jobs Platform
Data Science Mercor

Machine Learning Expert

Mercor • Remote

Education

Bachelor's

Type

Hourly

Pay

$70-120/hr

Your rate depends on your experience and the task.

Last checked

Today

Checked

Only apply if this role fits your skills and interests.

Send this job to a friend

New roles in Telegram: @aitrainerwork

About this role

From the Mercor listing

The research teams behind the best-known AI models come to Mercor for machine learning judgment they can't generate on their own. Your standards and expertise become the rubric that frontier AI is graded against.

This is a standing listing for machine learning practitioners who want AI training and evaluation work, not a specific job opening. It stays open whether or not a matching project is running this week.

New projects start on short notice, so instead of posting and pulling a listing each time, we keep one open per field and draw from it when one begins.

What the work looks like

We match machine learning practitioners in the network to projects like:

  • Writing a modeling problem from a system you actually shipped, with the data, the objective, and the constraint, plus the reference answer a model's attempt gets graded against

  • Grading model-written training and evaluation code: whether the loss matches the objective, whether the eval set leaks, whether the ablation supports the conclusion drawn from it

  • Flagging where a model proposes an approach that would train cleanly and still fail in production, given distribution shift, label noise, or a metric that rewards the wrong behaviour

Comparable machine learning projects have posted at $70 to $120 an hour, set per project by scope and depth.

What we're looking for

  • Professional experience training, evaluating, or deploying machine learning systems

  • Clear written communication, since most of the work involves explaining your reasoning

  • Comfort with ambiguous tasks, and willingness to flag unclear instructions

Where you trained matters less than whether you have put models in front of real users and dealt with what came back.

How it works

Apply here with your resume and confirm where you work from, then take a short AI interview, about 20 minutes total.

We verify your background and add you to the machine learning pool.

When a project needs machine learning expertise, we invite matching people from the pool to that specific listing. It names the rate, the hours, and the client, and any hiring decision is made there.

What to expect

This listing does not accept or reject candidates, so you will not get a decision on it. We reach out when a project matches your background. Depending on what our clients are running, that can be within a week or several months.

Finishing the domain expert interview and joining every network you qualify for both improve your odds of being matched. You only need to sign up once to be eligible across all of them.

How long hiring takes

On the platforms we refer people to, half of hires came within about 25 days of applying. Time from applying to hire:

Under 2 weeks
~30%
2 weeks to 6 weeks
~40%
6 weeks to 3 months
~15%
Over 3 months
~15%

Talent pool members

When your profile is a strong match, we can put you forward to Mercor. Set up your profile first if you haven't.

Set up your profile →

Machine Learning Engineer interview prep

Questions Machine Learning Engineer interviewers often ask. They aren't taken from this listing.

How do you choose between a simpler interpretable model and a more complex model that performs marginally better?

The decision depends on how the model's output is used downstream. If a human needs to act on and justify individual predictions, like in lending or healthcare, interpretability often outweighs a small accuracy gain. If the model feeds an automated system where explainability isn't a hard requirement, I'll take the complexity if the performance gain is meaningful and validated, not just noise.

Explain how you would set up a proper train, validation, and test split for a time series problem.

Random splitting leaks future information into training for time series, so I split chronologically instead, training on the earliest period, validating on the next, and testing on the most recent. Any cross-validation also needs to respect time order, using something like rolling-origin validation, rather than standard k-fold, which would otherwise let the model see the future during validation.

What statistical test would you use to determine if an A/B test result is significant, and what assumptions does it rely on?

For a conversion-rate comparison, a two-proportion z-test or chi-squared test is standard, and it assumes independent observations and a large enough sample size for the normal approximation to hold. If the sample is small or the metric isn't binary, I'd switch to a more appropriate test, since applying the wrong test's assumptions is a common source of false confidence in A/B results.

How do you approach hyperparameter tuning efficiently when the model is expensive to train?

I use a coarse random search first to identify the promising region of the hyperparameter space, since grid search wastes compute on combinations unlikely to matter. From there, Bayesian optimization narrows in on the best configuration with far fewer expensive training runs than an exhaustive search would require, which matters a lot when each run is costly.

See all 10 Machine Learning Engineer interview questions →

Typical contract length

Across 16 Mercor Data Science listings we've tracked, contracts typically run about 3.6 weeks. Length varies by project.

Why this role

You review and improve AI answers in Data Science, and this Machine Learning Expert role pays $70-120/hr for it.

Skills and categories

More jobs in these fields:

Related jobs

Verified reviews

Loading reviews…

Community reviews

Loading reviews…
💬

Share your experience with Mercor

Sign in to leave a review

Common questions

Does Mercor's application require an on-camera interview?

Yes. You record a video interview with an AI interviewer that asks about your resume, and clients watch it before they hire, so plan to be on camera.

Does it cost money to apply to Mercor?

No, applying to and joining Mercor is free. Mercor charges the client a fee on top of your rate. If anyone asks you to pay to join, treat it as a scam.

What does a typical day look like in expert AI training work?

Tasks are slow and careful. One task can take 45 to 60 minutes of checking citations or calculations, and you're judged on quality more than speed.

Is AI training work the same as traditional consulting?

It's closer to teaching. You grade the AI's logic, correct its mistakes and write the expert reasoning it lacks, instead of producing work for a client.

What does Data Science work look like for a Machine Learning Expert?

You check AI answers to Data Science questions, correct their errors and write expert reasoning. As a Machine Learning Expert, you're hired for that judgment, so hands-on Data Science experience matters.

How much does this specific role pay?

This listing is posted at $70-120/hr, an hourly rate. Where you land in the range depends on your background and the assessment. Pay can change after we check the listing, so confirm the rate on the platform's application page.

What happens when I click Apply on this listing?

Apply opens Mercor's site, where you create an account and follow its sign-up steps.

How soon will I start working after applying to Mercor?

Usually after a few weeks. Applying puts you in Mercor's pool of candidates, and you start once a client, such as an AI lab, picks your profile.