Skip to content
aitrainer.work - AI Training Jobs Platform
Healthcare Mercor

Dermatologist (MD) — Clinical Image Interpretation & AI Evaluation

Mercor • Remote

Education

Not stated

Type

Hourly

Pay

$270/hr

The rate in the listing.

Last checked

Today

Checked

Only apply if this role fits your skills and interests.

Send this job to a friend

New roles in Telegram: @aitrainerwork

About this role

From the Mercor listing

About the Role

Mercor is hiring board-certified Dermatologists for non-clinical work developing and evaluating clinical AI systems. You will apply your diagnostic expertise to image interpretation, annotation, and evaluation work that helps define what a clinically sound dermatological assessment looks like.

This is a non-clinical role — no direct patient care, and no responsibility for live diagnosis.

This is a shared expert pool. After onboarding you may be matched to any of several concurrent workstreams based on your subspecialty, availability, and interest. You are not committing to a single project, and you may move between streams as priorities shift.

What you may work on

Work varies by workstream and may include:

  • Case interpretation with written reasoning — working through clinical cases that pair dermatological images with patient history, recording your diagnostic reasoning step by step rather than only the final impression.

  • Structured image annotation — describing lesions against a defined schema: morphology, colour, configuration, distribution, and body site.

  • Differential and severity assessment — recording a ranked differential with your reasoning, and grading severity or progression from images.

  • Output review — judging AI-generated dermatological assessments against clinical standards, flagging hallucinated findings, missed findings, and unsupported certainty.

  • Grading criteria and guideline authoring — defining what separates an excellent assessment from a merely acceptable one, so judgment can be applied consistently at scale.

  • Difficult-case writing — constructing cases that probe the limits of current model reasoning, including presentations that vary across skin tones.

Task length varies by stream, from roughly 10 minutes for structured annotation up to an hour for full case authoring. You will get a specific throughput target for whichever stream you are matched to.

Required qualifications

  • MD or DO with completed dermatology residency

  • Board certification — ABD, or the equivalent certifying body in your jurisdiction — or board-eligible with residency complete

  • Active, unrestricted medical license in your country of practice

  • 3+ years post-residency clinical dermatology experience, practising or previously practising

  • Strong ability to identify and describe dermatological conditions in precise medical terminology, across the full range of skin tones

  • Written and spoken English fluency

  • Minimum 15 hours per week, with the ability to concentrate hours when a stream is time-boxed

Preferred qualifications

  • Fellowship or focused practice in dermatopathology, pediatric dermatology, surgical dermatology, or complex medical dermatology

  • U.S. licensure and board certification

  • Prior medical image annotation, AI evaluation, or dataset curation experience

  • Teaching, rubric design, or resident assessment experience

  • Published research or sustained technical writing (please link a sample)

Why this work

Dermatology is one of the most image-dependent specialties in medicine, and one where model performance still varies sharply across skin tones and rarer presentations. The reference standard these systems get graded against is written by dermatologists — here you would be writing it.

Requirements

  • Fluent proficiency in English (Written & Verbal)
  • Reliable high-speed internet connection
  • Bachelor's degree or equivalent professional experience
  • Demonstrated expertise in Healthcare
  • Valid professional license or certification in the relevant clinical/health field (MD, DO, RN, RD, NBHWC, etc.)
  • Current knowledge of medical standards and practices

How long hiring takes

On the platforms we refer people to, half of hires came within about 25 days of applying. Time from applying to hire:

Under 2 weeks
~30%
2 weeks to 6 weeks
~40%
6 weeks to 3 months
~15%
Over 3 months
~15%

Talent pool members

When your profile is a strong match, we can put you forward to Mercor. Set up your profile first if you haven't.

Set up your profile →

AI Evaluation Engineer interview prep

Questions AI Evaluation Engineer interviewers often ask. They aren't taken from this listing.

How do you design an evaluation set that catches the failure modes you're worried about, instead of mostly easy cases?

I start from known or suspected failure modes and write examples that specifically target them, rather than sampling broadly and hoping coverage happens naturally. A random sample tends to be dominated by easy cases the model already handles well, which tells you little about where it breaks.

What's your process for deciding whether a model regression is a real problem or noise in the eval?

I check whether the drop is consistent across multiple runs and whether it's concentrated in a specific category rather than spread thinly across everything. A real regression usually has a pattern behind it; pure noise tends to be scattered and doesn't reproduce reliably.

How do you evaluate a model's output when there's no single correct answer, only better and worse ones?

I define what specifically makes one response better, like factual grounding, completeness, or reasoning quality, and evaluate against those explicit criteria rather than an overall gut impression, since a vague preference judgment doesn't generalize well across raters or over time.

How do you keep an evaluation benchmark from becoming stale as the model improves and starts passing it trivially?

I track pass rates over time and treat a benchmark approaching ceiling as a signal to add harder cases, rather than treating consistently high scores as a finished success. A benchmark that stops discriminating between good and bad outputs has stopped being useful, even if the score still looks good.

See all 10 AI Evaluation Engineer interview questions →

Why this role

At $270/hr, this Dermatologist (MD) — Clinical Image Interpretation & AI Evaluation role asks you to check AI answers in Healthcare the way a colleague in your field would.

Skills and categories

More jobs in these fields:

Related jobs

Verified reviews

Loading reviews…

Community reviews

Loading reviews…
💬

Share your experience with Mercor

Sign in to leave a review

Common questions

Does Mercor's application require an on-camera interview?

Yes. You record a video interview with an AI interviewer that asks about your resume, and clients watch it before they hire, so plan to be on camera.

Does it cost money to apply to Mercor?

No, applying to and joining Mercor is free. Mercor charges the client a fee on top of your rate. If anyone asks you to pay to join, treat it as a scam.

What does a typical day look like in expert AI training work?

Tasks are slow and careful. One task can take 45 to 60 minutes of checking citations or calculations, and you're judged on quality more than speed.

Is AI training work the same as traditional consulting?

It's closer to teaching. You grade the AI's logic, correct its mistakes and write the expert reasoning it lacks, instead of producing work for a client.

What does Healthcare work look like for a Dermatologist (MD) — Clinical Image Interpretation & AI Evaluation?

You check AI answers to Healthcare questions, correct their errors and write expert reasoning. As a Dermatologist (MD) — Clinical Image Interpretation & AI Evaluation, you're hired for that judgment, so hands-on Healthcare experience matters.

What specific skills does this listing call for?

English is named directly in the listing. If you don't have hands-on experience with this, expect the screening to test for it.

How much does this specific role pay?

This listing is posted at $270/hr, an hourly rate. Pay can change after we check the listing, so confirm the rate on the platform's application page.

What happens when I click Apply on this listing?

Apply opens Mercor's site, where you create an account and follow its sign-up steps.

How soon will I start working after applying to Mercor?

Usually after a few weeks. Applying puts you in Mercor's pool of candidates, and you start once a client, such as an AI lab, picks your profile.