Skip to content
aitrainer.work - AI Training Jobs Platform
Healthcare Mercor

Multilingual Primary Care Physician (MD) — Clinical Documentation & AI Evaluation

Mercor • Remote, United States, China, France, Germany, Hungary, Indonesia, Italy, Japan, Philippines, South Korea

Education

Not stated

Type

Hourly

Pay

$170-190/hr

Your rate depends on your experience and the task.

Last checked

4d ago

Checked

Only apply if this role fits your skills and interests.

Send this job to a friend

New roles in Telegram: @aitrainerwork

About this role

From the Mercor listing

About the Role

Mercor is hiring practicing Primary Care Physicians (MD) on behalf of a healthcare AI partner building advanced clinical documentation and decision-support tools. In this role you will apply your day-to-day outpatient expertise to review, annotate, and evaluate clinical documentation, directly shaping the accuracy, safety, and clinical usefulness of medical AI systems.

This role is designed for clinicians who are currently practicing primary care, family medicine, or general internal medicine and who write outpatient clinical notes as part of their regular work.

This is a multilingual cohort. In addition to English, you must be able to speak, listen, and write in at least one other language at an advanced (C1) level or above.

Key Responsibilities

Clinical Documentation Review

  • Review outpatient clinical notes, encounter summaries, and EHR documentation for accuracy, completeness, and clinical soundness

  • Evaluate AI-generated notes and summaries against what a practicing PCP would actually document

Annotation & Structured Feedback

  • Annotate outpatient encounter data against detailed guidelines

  • Flag omissions, hallucinations, clinical inaccuracies, and documentation gaps in AI-generated output

  • Provide structured, written feedback that engineering and product teams can act on

Knowledge Contribution

  • Contribute expert input on annotation guidelines, documentation standards, and edge-case definitions

  • Raise clarifying questions where guidance is ambiguous and help refine the guidelines

Required Qualifications

  • MD, with 2+ years post-residency, currently practicing primary care / family medicine / general internal medicine

  • US-based

  • Direct experience writing clinical notes in an outpatient setting

  • In addition to English, advanced (C1 or above) proficiency — speaking, listening, and writing — in at least one of the following languages:

    • Spanish · Chinese (Mandarin) · Chinese (Cantonese) · Tagalog · Russian · Haitian Creole

    • Korean · Arabic · Portuguese · Polish · Japanese

    • Turkish · Italian · Ukrainian · Romanian · Finnish · French · Danish · Catalan · Hungarian · Czech · German · Bulgarian · Indonesian · Dutch

  • Minimum availability of 10 hours/week

Preferred Qualifications

  • 5+ years of experience post-residency

  • Familiarity with Epic

  • Experience with clinical documentation quality review, note auditing, or CDI exposure

  • Prior AI/ML annotation or model evaluation work experience, with strong performance reviews

  • Experience documenting patient care in a language other than English

Work Arrangement

  • Remote, part-time — minimum 10 hours/week

  • Flexible scheduling, designed around an active clinical practice

Requirements

  • Must be eligible to work in one of: United States, China, France, and more
  • Fluent proficiency in English (Written & Verbal)
  • Reliable high-speed internet connection
  • Bachelor's degree or equivalent professional experience
  • Demonstrated expertise in Healthcare
  • Valid professional license or certification in the relevant clinical/health field (MD, DO, RN, RD, NBHWC, etc.)
  • Current knowledge of medical standards and practices

How long hiring takes

On the platforms we refer people to, half of hires came within about 25 days of applying. Time from applying to hire:

Under 2 weeks
~30%
2 weeks to 6 weeks
~40%
6 weeks to 3 months
~15%
Over 3 months
~15%

Talent pool members

When your profile is a strong match, we can put you forward to Mercor. Set up your profile first if you haven't.

Set up your profile →

AI Evaluation Engineer interview prep

Questions AI Evaluation Engineer interviewers often ask. They aren't taken from this listing.

How do you design an evaluation set that catches the failure modes you're worried about, instead of mostly easy cases?

I start from known or suspected failure modes and write examples that specifically target them, rather than sampling broadly and hoping coverage happens naturally. A random sample tends to be dominated by easy cases the model already handles well, which tells you little about where it breaks.

What's your process for deciding whether a model regression is a real problem or noise in the eval?

I check whether the drop is consistent across multiple runs and whether it's concentrated in a specific category rather than spread thinly across everything. A real regression usually has a pattern behind it; pure noise tends to be scattered and doesn't reproduce reliably.

How do you evaluate a model's output when there's no single correct answer, only better and worse ones?

I define what specifically makes one response better, like factual grounding, completeness, or reasoning quality, and evaluate against those explicit criteria rather than an overall gut impression, since a vague preference judgment doesn't generalize well across raters or over time.

How do you keep an evaluation benchmark from becoming stale as the model improves and starts passing it trivially?

I track pass rates over time and treat a benchmark approaching ceiling as a signal to add harder cases, rather than treating consistently high scores as a finished success. A benchmark that stops discriminating between good and bad outputs has stopped being useful, even if the score still looks good.

See all 10 AI Evaluation Engineer interview questions →

Eligible languages

Fluent proficiency in one or more of: Arabic, Bulgarian, Cantonese, Chinese, Czech, Danish, Dutch, English, Finnish, or French

Arabic Bulgarian Cantonese Chinese Czech Danish Dutch English Finnish French German Hungarian Indonesian Italian Japanese Korean Mandarin Polish Portuguese Romanian Russian Spanish Tagalog Turkish Ukrainian

Why this role

At $170-190/hr, this Multilingual Primary Care Physician (MD) — Clinical Documentation & AI Evaluation role asks you to check AI answers in Healthcare the way a colleague in your field would.

Skills and categories

More jobs in these fields:

Related jobs

Verified reviews

Loading reviews…

Community reviews

Loading reviews…
💬

Share your experience with Mercor

Sign in to leave a review

Common questions

Does it cost money to apply to Mercor?

No, applying to and joining Mercor is free. Mercor charges the client a fee on top of your rate. If anyone asks you to pay to join, treat it as a scam.

Is Mercor for freelancers or full-time contractors?

Mercor places you with one client for a set contract, such as 'Python Tutor for 3 months'. Most roles are steady contract work rather than one-off tasks.

Is AI training work the same as traditional consulting?

It's closer to teaching. You grade the AI's logic, correct its mistakes and write the expert reasoning it lacks, instead of producing work for a client.

Why do expert AI training roles pay well?

The model already knows the basics. It needs help with hard edge cases, the judgment calls a senior professional in the field gets right.

What does Healthcare work look like for a Multilingual Primary Care Physician (MD) — Clinical Documentation & AI Evaluation?

You check AI answers to Healthcare questions, correct their errors and write expert reasoning. As a Multilingual Primary Care Physician (MD) — Clinical Documentation & AI Evaluation, you're hired for that judgment, so hands-on Healthcare experience matters.

What specific skills does this listing call for?

Arabic, Bulgarian, Cantonese, and Chinese are named directly in the listing. If you don't have hands-on experience with these, expect the screening to test for them.

How much does this specific role pay?

This listing is posted at $170-190/hr, an hourly rate. Where you land in the range depends on your background and the assessment. Pay can change after we check the listing, so confirm the rate on the platform's application page.

Do I need to be fluent in Arabic, Bulgarian, Cantonese, Chinese, Czech, Danish, Dutch, English, Finnish, French, German, Hungarian, Indonesian, Italian, Japanese, Korean, Mandarin, Polish, Portuguese, Romanian, Russian, Spanish, Tagalog, Turkish, or Ukrainian?

Yes. This role needs fluent Arabic, Bulgarian, Cantonese, Chinese, Czech, Danish, Dutch, English, Finnish, French, German, Hungarian, Indonesian, Italian, Japanese, Korean, Mandarin, Polish, Portuguese, Romanian, Russian, Spanish, Tagalog, Turkish, or Ukrainian, as well as the English most AI training work uses. If you aren't fluent, search for roles in the languages you speak.

What happens when I click Apply on this listing?

Apply opens Mercor's site, where you create an account and follow its sign-up steps.

Can I apply from outside the United States, China, France and 7 other countries?

This role is open only to people based in the United States, China, France, Germany, Hungary, Indonesia, Italy, Japan, the Philippines, and South Korea. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply, since they can differ by country.

How soon will I start working after applying to Mercor?

Usually after a few weeks. Applying puts you in Mercor's pool of candidates, and you start once a client, such as an AI lab, picks your profile.