Skip to content
aitrainer.work - AI Training Jobs Platform
Healthcare Mercor

Certified Medical Coder (ICD-10) — Multilingual Clinical Documentation & AI Evaluation

Mercor • Remote, United States

Education

Not stated

Type

Hourly

Pay

$45-65/hr

Your rate depends on your experience and the task.

Last checked

4d ago

Checked

Only apply if this role fits your skills and interests.

Send this job to a friend

New roles in Telegram: @aitrainerwork

About this role

From the Mercor listing

About the Role

Mercor is hiring certified medical coders on behalf of a healthcare AI partner building advanced clinical documentation tools. In this role you will apply your coding and documentation expertise to review, annotate, and evaluate clinical documentation and AI-generated clinical notes, directly shaping the accuracy and reliability of medical AI systems.

This role is part of a multilingual annotation cohort. In addition to English, you should be able to speak, read, and write at least one other language at an advanced (C1 or above) level.

Key Responsibilities

Documentation & Coding Review

  • Review clinical documentation for accuracy, completeness, and coding integrity

  • Evaluate AI-generated clinical notes and summaries against real-world documentation and coding standards

  • Validate alignment between clinical documentation and assigned codes

Annotation & Structured Feedback

  • Annotate clinical documentation against detailed guidelines

  • Flag omissions, inaccuracies, and documentation gaps in AI-generated output

  • Provide structured, written feedback that engineering and product teams can act on

Knowledge Contribution

  • Contribute expert input on annotation guidelines and documentation standards

  • Raise clarifying questions where guidance is ambiguous and help refine the guidelines

Required Qualifications

  • Active certification — at least one of CCDS, CHC, CCS, or CPC

  • ICD-10 coding experience

  • Currently working in medical coding, clinical documentation improvement, or a closely related documentation role

  • US-based

  • In addition to English, advanced (C1+) proficiency — speaking, listening, and writing — in at least one other language

  • Availability of at least 10 hours per week

Preferred Qualifications

  • Additional certifications (CRC, CDIP, or similar)

  • Familiarity with Epic

  • Experience with HCC or risk-adjustment coding

  • Prior AI/ML annotation or model evaluation work experience, with strong performance reviews

Work Arrangement

  • Remote, part-time — minimum 10 hours/week

  • Flexible scheduling

Requirements

  • Must be eligible to work in United States
  • Fluent proficiency in English (Written & Verbal)
  • Reliable high-speed internet connection
  • Bachelor's degree or equivalent professional experience
  • Demonstrated expertise in Healthcare
  • Valid professional license or certification in the relevant clinical/health field (MD, DO, RN, RD, NBHWC, etc.)
  • Current knowledge of medical standards and practices

How long hiring takes

On the platforms we refer people to, half of hires came within about 25 days of applying. Time from applying to hire:

Under 2 weeks
~30%
2 weeks to 6 weeks
~40%
6 weeks to 3 months
~15%
Over 3 months
~15%

Talent pool members

When your profile is a strong match, we can put you forward to Mercor. Set up your profile first if you haven't.

Set up your profile →

AI Evaluation Engineer interview prep

Questions AI Evaluation Engineer interviewers often ask. They aren't taken from this listing.

How do you design an evaluation set that catches the failure modes you're worried about, instead of mostly easy cases?

I start from known or suspected failure modes and write examples that specifically target them, rather than sampling broadly and hoping coverage happens naturally. A random sample tends to be dominated by easy cases the model already handles well, which tells you little about where it breaks.

What's your process for deciding whether a model regression is a real problem or noise in the eval?

I check whether the drop is consistent across multiple runs and whether it's concentrated in a specific category rather than spread thinly across everything. A real regression usually has a pattern behind it; pure noise tends to be scattered and doesn't reproduce reliably.

How do you evaluate a model's output when there's no single correct answer, only better and worse ones?

I define what specifically makes one response better, like factual grounding, completeness, or reasoning quality, and evaluate against those explicit criteria rather than an overall gut impression, since a vague preference judgment doesn't generalize well across raters or over time.

How do you keep an evaluation benchmark from becoming stale as the model improves and starts passing it trivially?

I track pass rates over time and treat a benchmark approaching ceiling as a signal to add harder cases, rather than treating consistently high scores as a finished success. A benchmark that stops discriminating between good and bad outputs has stopped being useful, even if the score still looks good.

See all 10 AI Evaluation Engineer interview questions →

Why this role

This Certified Medical Coder (ICD-10) — Multilingual Clinical Documentation & AI Evaluation role pays $45-65/hr and is fully remote, so you can do Healthcare work for an AI lab from home.

Skills and categories

More jobs in these fields:

Related jobs

Verified reviews

Loading reviews…

Community reviews

Loading reviews…
💬

Share your experience with Mercor

Sign in to leave a review

Common questions

Is Mercor for freelancers or full-time contractors?

Mercor places you with one client for a set contract, such as 'Python Tutor for 3 months'. Most roles are steady contract work rather than one-off tasks.

Does Mercor's application require an on-camera interview?

Yes. You record a video interview with an AI interviewer that asks about your resume, and clients watch it before they hire, so plan to be on camera.

Can I choose my own hours?

Usually, yes. You log in when you want, pick up a task, finish it and submit it, with no meetings. Other people work from the same pool of tasks, so some days there may be no work until more is added.

What does Healthcare work look like for a Certified Medical Coder (ICD-10) — Multilingual Clinical Documentation & AI Evaluation?

You check AI answers to Healthcare questions, correct their errors and write expert reasoning. As a Certified Medical Coder (ICD-10) — Multilingual Clinical Documentation & AI Evaluation, you're hired for that judgment, so hands-on Healthcare experience matters.

What specific skills does this listing call for?

English and Multilingual are named directly in the listing. If you don't have hands-on experience with these, expect the screening to test for them.

How much does this specific role pay?

This listing is posted at $45-65/hr, an hourly rate. Where you land in the range depends on your background and the assessment. Pay can change after we check the listing, so confirm the rate on the platform's application page.

What happens when I click Apply on this listing?

Apply opens Mercor's site, where you create an account and follow its sign-up steps.

Can I apply from outside the United States?

This role is open only to people based in the United States. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply.

How soon will I start working after applying to Mercor?

Usually after a few weeks. Applying puts you in Mercor's pool of candidates, and you start once a client, such as an AI lab, picks your profile.