Skip to content
aitrainer.work - AI Training Jobs Platform
Finance

AI Trainer, Mortgage Servicing (Part-time)

Kastle • Remote, open in United States

Education

Not stated

Type

Hourly

Pay

$30/hr

The rate in the listing.

Last checked

13d ago

Checked

Send this job to a friend

New roles in Telegram: @aitrainerwork

About this role

From the Kastle listing

Kastle (Y Combinator S24) builds AI voice agents that answer calls for mortgage lenders and servicers. This role trains those agents using your experience on the phones.

What you'll do:
- Label and annotate recorded mortgage servicing conversations
- Rate the AI's answers for accuracy and helpfulness, and write feedback where it gets things wrong
- Test the voice agent on servicing calls and flag quality problems, from wrong answers to a poor caller experience

The work is about 10 hours a week, remote from anywhere in the US, on a schedule you set.

You need 5+ years as a customer service agent at a mortgage servicing company, handling calls about escrow, payments, loss mitigation and servicing transfers. Experience as a mortgage customer service supervisor, or coaching agents, is a plus.

Requirements

  • Must be eligible to work in United States
  • Fluent proficiency in English (Written & Verbal)
  • Reliable high-speed internet connection

AI Trainer interview prep

Questions AI Trainer interviewers often ask. They aren't taken from this listing.

How do you evaluate whether a model's response to a prompt satisfies the instruction, versus just sounding plausible?

I go back to the instruction line by line and check each requirement against the response individually, rather than reading the response holistically and asking if it feels right. A confident, well-written response can still quietly skip a constraint the prompt asked for.

What's your process for writing a rating rubric that two different reviewers would apply the same way?

I define each rating level with a concrete example rather than an abstract description, since two reviewers can read the same adjective differently but usually agree on whether a response matches a given example. I test the rubric on a handful of edge cases with another reviewer before rolling it out.

How do you decide when a prompt itself is ambiguous versus when the model's response is simply wrong?

I ask whether a reasonable person could interpret the prompt more than one way and still be following the instruction correctly. If the response fails under every reasonable reading, it's a model error; if it only fails under one specific reading, the prompt needs to be flagged as ambiguous instead.

How do you document the reasoning behind a rating so someone reviewing your work later understands the decision?

I write a short note pointing to the specific part of the response that drove the rating, so a reviewer can see what I was reacting to. A rating with no reasoning attached is hard to audit and even harder to disagree with productively.

See all 10 AI Trainer interview questions →

Why this role

At $30/hr, this remote AI Trainer, Mortgage Servicing (Part-time) role doesn't ask you to move or come into an office.

Skills and categories

More jobs in these fields:

Related jobs

Verified reviews

Loading reviews…

Community reviews

Loading reviews…
💬

Share your experience with Kastle

Sign in to leave a review

Common questions

Is AI training work the same as traditional consulting?

It's closer to teaching. You grade the AI's logic, correct its mistakes and write the expert reasoning it lacks, instead of producing work for a client.

Why do expert AI training roles pay well?

The model already knows the basics. It needs help with hard edge cases, the judgment calls a senior professional in the field gets right.

What does Finance work look like for an AI Trainer, Mortgage Servicing (Part-time)?

You check AI answers to Finance questions, correct their errors and write expert reasoning. As an AI Trainer, Mortgage Servicing (Part-time), you're hired for that judgment, so hands-on Finance experience matters.

What specific skills does this listing call for?

English is named directly in the listing. If you don't have hands-on experience with this, expect the screening to test for it.

How much does this specific role pay?

This listing is posted at $30/hr, an hourly rate. Pay can change after we check the listing, so confirm the rate on the platform's application page.

Can I apply from outside the United States?

This role is open only to people based in the United States. The limit is usually about where the platform can legally hire, so applying from elsewhere rarely leads to an offer. Check the description for tax or right-to-work rules before you apply.