Skip to content
aitrainer.work - AI Training Jobs Platform
Generalist Handshake

Intelligence Expert (Bachelor's, Master's and PhDs) - AI Trainer

Handshake • Remote

Education

PhD

Type

Hourly

Pay

$200/hr

The rate in the listing.

Last checked

14d ago

Checked

Only apply if this role fits your skills and interests.

Send this job to a friend

New roles in Telegram: @aitrainerwork

Role overview

As a Intelligence Expert (Bachelor's, Master's and PhDs) - AI Trainer, you give feedback on AI answers so the model learns context and intent, using what you know about Generalist.

Requirements

  • Fluent proficiency in English (Written & Verbal)
  • Reliable high-speed internet connection
  • PhD's degree or equivalent professional experience
  • Demonstrated expertise in Generalist
  • Current university student or recent graduate with .edu email

AI Trainer interview prep

Questions AI Trainer interviewers often ask. They aren't taken from this listing.

How do you evaluate whether a model's response to a prompt satisfies the instruction, versus just sounding plausible?

I go back to the instruction line by line and check each requirement against the response individually, rather than reading the response holistically and asking if it feels right. A confident, well-written response can still quietly skip a constraint the prompt asked for.

What's your process for writing a rating rubric that two different reviewers would apply the same way?

I define each rating level with a concrete example rather than an abstract description, since two reviewers can read the same adjective differently but usually agree on whether a response matches a given example. I test the rubric on a handful of edge cases with another reviewer before rolling it out.

How do you decide when a prompt itself is ambiguous versus when the model's response is simply wrong?

I ask whether a reasonable person could interpret the prompt more than one way and still be following the instruction correctly. If the response fails under every reasonable reading, it's a model error; if it only fails under one specific reading, the prompt needs to be flagged as ambiguous instead.

How do you document the reasoning behind a rating so someone reviewing your work later understands the decision?

I write a short note pointing to the specific part of the response that drove the rating, so a reviewer can see what I was reacting to. A rating with no reasoning attached is hard to audit and even harder to disagree with productively.

See all 10 AI Trainer interview questions →

Why this role

At $200/hr, this Intelligence Expert (Bachelor's, Master's and PhDs) - AI Trainer role asks you to check AI answers in Generalist the way a colleague in your field would.

Skills and categories

More jobs in these fields:

Related jobs

Verified reviews

Loading reviews…

Community reviews

Loading reviews…
💬

Share your experience with Handshake

Sign in to leave a review

Common questions

Can I use Handshake if I graduated years ago?

Handshake's AI Fellowship roles are aimed at current students and people within about 1 to 2 years of graduating. If you graduated earlier, look at the other platforms on this board too.

Is Handshake itself the employer for AI training roles?

For AI Fellowship roles, yes, Handshake is the employer of record. For other listings on Handshake, the employer is the company that posted the job.

What does a typical day look like in expert AI training work?

Tasks are slow and careful. One task can take 45 to 60 minutes of checking citations or calculations, and you're judged on quality more than speed.

Is AI training work the same as traditional consulting?

It's closer to teaching. You grade the AI's logic, correct its mistakes and write the expert reasoning it lacks, instead of producing work for a client.

What does Generalist work look like for an Intelligence Expert (Bachelor's, Master's and PhDs) - AI Trainer?

You check AI answers to Generalist questions, correct their errors and write expert reasoning. As an Intelligence Expert (Bachelor's, Master's and PhDs) - AI Trainer, you're hired for that judgment, so hands-on Generalist experience matters.

What specific skills does this listing call for?

Master's is named directly in the listing. If you don't have hands-on experience with this, expect the screening to test for it.

How much does this specific role pay?

This listing is posted at $200/hr, an hourly rate. Pay can change after we check the listing, so confirm the rate on the platform's application page.

What happens when I click Apply on this listing?

Apply opens Handshake's site, where you create an account and follow its sign-up steps.

Is a PhD required?

For this role, yes, or similar professional depth, and the assessment checks it. PhD candidates and people with published research have qualified without the degree.

Are Handshake AI training listings internships?

Some are. Handshake lists internships and separate "AI Trainer" fellowships. If the description says "1099" or "Contract", the role is freelance work.