Skip to content
aitrainer.work - AI Training Jobs Platform
DataAnnotation assessment steps: a five-step path with the Starter and Core checked off and a review screen showing the DataAnnotation logo
Beginner Career Guides

DataAnnotation Assessment: Starter, Core and the Wait After

How long the DataAnnotation Starter and Core assessments take, what each screen after you submit means, and how long people wait to hear back.

10 min read

The DataAnnotation assessment is two unpaid tests, a Starter Assessment of about an hour and a longer Core or subject assessment, followed by an identity check and a wait. You get one attempt, and DataAnnotation never tells you that you failed, so knowing what each step and each screen means is most of the preparation.

The long waits sit between the tests rather than inside them. The steps run in this order.

  1. Sign up and fill in your profile (role, languages, education, country).
  2. Take the Starter Assessment.
  3. Take the Core Assessment or a subject assessment.
  4. Verify your identity through Persona.
  5. Get a decision, then qualifications, then paid projects.

Timings below come from DataAnnotation's own FAQ where it gives one, and otherwise from worker reports between June and October 2026. If you are still deciding whether to apply, our DataAnnotation review covers legitimacy and how payouts work.

One unpaid attempt, no rejection email, and a dashboard you have to keep checking

  • The Starter Assessment can be taken once per account. DataAnnotation's FAQ says there are no retakes.
  • Plan for 90 minutes to 3 hours on the Starter, even though DataAnnotation estimates about an hour. Workers report no visible timer.
  • A Starter pass is not acceptance. The Core or subject assessment comes next, and accepted applicants describe it as about 14 to 15 tasks.
  • "Thanks for taking the assessment" means submitted. It looks the same whether you passed or not.
  • Past three to four weeks with no change, plan as if you did not pass. Some acceptances still arrive one to two months later.
  • Search to check facts, and write every answer yourself. Worker communities treat AI-written answers as disqualifying.
  • An empty dashboard after acceptance is normal for the first weeks. Qualifications come first, and workers estimate 3 to 4 weeks before steady paid projects.

The DataAnnotation Starter Assessment takes about an hour, and most people who pass spend longer

DataAnnotation's FAQ puts the Starter Assessment at about an hour. Applicants who pass report spending 90 minutes to 3 hours on it, most of that on checking facts, and the coding version is reported at about 3 hours. Workers report no visible timer, and DataAnnotation does not say whether it records how long you take.

The Starter is unpaid and built from the same kinds of work you would do once accepted: reading chatbot responses, judging them against instructions, and explaining your judgment in writing. It differs by track, so a generalist, a coder and a bilingual applicant see different versions. Applicants who pass describe checking each claim in a response instead of trusting it.

Because there is no second attempt, practice on a rubric before you start. The free Academy mock exam scores you on rating, fact-checking and instruction-following, and shows where your judgment drifts from the rubric.

Your profile decides which assessment you see

The assessments on your dashboard depend on what you entered at sign-up: the role you chose, your languages, your education and your country. If the assessment you expected is not there, the profile is the only thing you can change. Update your languages and field, then check back over the following days.

Some applicants outside the six countries where general English work is open (the US, UK, Canada, Australia, New Zealand and Ireland) are offered only bilingual assessments. Others see no assessment at all for months, and one worker found a full list of assessments appear a year after signing up. An assessment in an unexpected language usually traces back to a language listed on the profile.

Apply from the country you live in. Workers report accounts closed for VPN use.

Subject tracks add a longer test in your field

DataAnnotation's FAQ lists specialized assessments for coding, math, chemistry, biology, physics, finance, law, medicine and languages, and puts each at 1 to 2 hours. Its homepage lists 107 roles, including accounting and healthcare. A subject assessment tests whether you can judge AI answers in your field and explain the errors in writing.

The coding assessment is reported at about 3 hours of reviewing code and explaining what is wrong with it. The other subject tests follow the same format with material from the field. Workers report decisions on bilingual assessments taking about two weeks.

Requirements differ by page. DataAnnotation's FAQ asks for advanced degrees on STEM tracks, while its math page says "No degree required", so read the requirements on the track page you apply through. For what each track pays, see DataAnnotation pay by category.

The DataAnnotation Core Assessment runs about 15 tasks when it goes well

After a Starter pass, many applicants get the Core Assessment right away or within 2 to 3 days. Workers who were accepted describe a Core of about 14 to 15 tasks. Some applicants who got a single task, or were stopped after about seven, did not hear back, and worker communities read a short Core as a bad sign. That is a reported pattern, and DataAnnotation has not confirmed it.

The format mixes multiple-choice ratings with written explanations, and the instructions are long and detailed, including suggested response lengths. Fact-checking is expected on every task. It takes longer than the Starter, and one applicant reported 6 hours. The Core is unpaid.

Each screen after you submit means something different

DataAnnotation has no "failed" status and sends no rejection email. A rejection looks like a thank-you page that never changes. Match the text you see to the row.

Screen What it means What to do
We review your results. If you pass, we'll email you. Starter submitted, under review. Wait, and check the dashboard as well as your inbox.
Check back in a few days to see your results! Core submitted. Check back every few days. Results are often slower than "a few days".
Thanks for taking the assessment… we will be in touch if we require your expertise Submitted. The same page shows whether you pass or not, and it can reappear after the ID check while a decision is pending. If it is still there after three to four weeks, plan as if you did not pass. No rejection email will come.
Processing Identity Verification, then "You've been rate limited" The Persona ID check is stuck in a loop, reported widely in June and July 2026. Stop refreshing and come back in a few days. Refreshing extends the block.
At the moment, there aren't any projects available… Accepted, with no projects yet. Normal for the first weeks. Check daily for qualifications, which appear before paid projects.
Your account is currently unavailable for new projects due to work below our quality standards Removed from new work after acceptance. See the empty dashboard guide.

Most people hear back within weeks, and some much later

DataAnnotation says you hear back "within a few days". Worker reports run from minutes to several weeks, and some acceptances arrive one to two months after the Core. Workers' rule of thumb is that after three to four weeks with no change, you should plan as if you did not pass. Late acceptances do happen, so keep the account and check it now and then.

Acceptance can come as a welcome email or only as a change on the dashboard, with no email at all. Check the dashboard directly instead of waiting for the inbox. While you wait, applying to a second platform costs nothing, and the matcher shows open roles that fit your background.

Look things up, but write every answer yourself

Checking facts with a search engine is part of the work. Applicants who were accepted describe researching every claim in a response before rating it. Every worker community treats AI-written answers as disqualifying. DataAnnotation's FAQ does not address AI tools, and with one attempt per account, it is not a rule worth testing.

To practice judging and explaining AI responses in your own words, use the Academy practice tasks, which grade rating, fact-checking and written justifications.

A missing Core Assessment or a rate-limit error usually means wait

Three versions of a missing Core are reported: the Core opens with a message that no tasks remain, the link loops back to the thank-you page, or the Core vanishes overnight after a Starter pass. Nobody reports a reliable fix, and support replies are rare. Treat it as the waiting state, keep your profile current and check back every few days.

The identity check runs through Persona and asks for a government photo ID and a face check. It officially takes minutes. In June and July 2026 many applicants in the US and India were stuck on "Processing Identity Verification", followed by "You've been rate limited". The block cleared after a few days of waiting, and refreshing made it last longer.

Acceptance comes first, then qualifications, then paid projects

A new account usually opens to "At the moment, there aren't any projects available". Workers estimate 3 to 4 weeks between acceptance and steady paid projects. DataAnnotation's FAQ says project availability depends on demand for your skills and on your past work.

Qualifications appear first, some paid and some unpaid. Each qualifier states at the top how many tasks it needs before you are considered, so there is no single number to aim for. Paid training projects work like qualifications: you are paid at the rate shown on your dashboard, but a weak result keeps you out of that project family. Treat the first paid tasks as the rest of the assessment.

If your account had projects and they stopped, that is a different situation. Our guide to the DataAnnotation empty dashboard covers dry spells, client pauses and removals.

You get one attempt per account

DataAnnotation's FAQ says "You can only take the Starter Assessment once. There are no retakes or second chances." There is no reapplication process, and failing is never stated: the thank-you page stays on the dashboard.

Workers say a second account breaks the terms and report accounts closed for it, so opening one risks losing both. Most rejections come from missing the grading rubric rather than a lack of knowledge, which our guide on why data annotation is hard to get into explains.

Other platforms test the same skills if you did not get in

Rating AI responses, checking facts and explaining a judgment in writing are what many evaluation roles on other platforms ask for. A DataAnnotation rejection does not carry over to any other platform, and their assessments use their own rubrics.

The roles below are open AI response evaluation work on our board. For platforms closest to DataAnnotation, see DataAnnotation alternatives, or use the matcher to find roles that fit your field.

Open AI Response Evaluation Roles

Found 6 jobs matching "ai response"

Claru data collection and annotation platform, by Reka AI

Legal Reasoning AI Response Evaluator

Claru59d agoLegal$55-100/hr
Turing remote developer platform

Small business owners (AI response evaluation)

Turing179d agoGeneralist$15-30/hr · our estimate
Turing remote developer platform

Small business owners (AI response evaluation) - Indonesian Business Document

Turing188d agoLanguages$15-30/hr · our estimate
Turing remote developer platform

Small business owners (AI response evaluation) - Japanese Business Document

Turing193d agoLanguages$15-30/hr · our estimate
Turing remote developer platform

Small business owners (AI response evaluation) - Korean Business Document

Turing193d agoLanguages$15-30/hr · our estimate
Turing remote developer platform

Small business owners (AI response evaluation) - Spanish Business Documents

Turing193d agoLanguages$15-30/hr · our estimate

Frequently asked questions

Is the DataAnnotation assessment timed? ▼

Workers report no visible timer on the Starter or Core Assessment. DataAnnotation estimates about an hour for the Starter and 1 to 2 hours for specialized assessments, and applicants who pass often take 90 minutes to 3 hours. DataAnnotation does not say whether it records time spent, so work at the pace careful answers need.

How many questions is the DataAnnotation core assessment? ▼

Applicants who were accepted describe about 14 to 15 tasks. Some applicants who received a single task, or were stopped after about seven, did not hear back afterward. That is a pattern workers report, and DataAnnotation has not confirmed it.

What does "thanks for taking the assessment" mean on DataAnnotation? ▼

It means your assessment was submitted, and nothing more. The same page appears whether you pass or not. If you are not accepted it stays on your dashboard indefinitely, because DataAnnotation sends no rejection email. It can also reappear after the identity check while a decision is pending.

How long after the DataAnnotation assessment do you hear back? ▼

DataAnnotation says within a few days, and workers report anything from minutes to several weeks. Some acceptances arrive one to two months after the Core Assessment. If nothing has changed after three to four weeks, plan as if you did not pass and keep checking the dashboard.

Can you retake the DataAnnotation assessment? ▼

No. DataAnnotation's FAQ says the Starter Assessment can be taken once, with no retakes or second chances. That applies to the account, so a weak first attempt cannot be replaced by a second one.

Does DataAnnotation pay for qualifications? ▼

Some qualifications are paid and some are not, and the Starter and Core assessments are unpaid. Qualifications appear after you are accepted. Paid ones are paid at the rate shown on your dashboard, and a weak result can still keep you out of that project family.

Can you use Google or ChatGPT on the DataAnnotation assessment? ▼

Searching to check facts is expected, and AI tools are treated as disqualifying. DataAnnotation's FAQ does not address AI tools, but every worker community treats AI-written answers as a reason for rejection. Look facts up, then write every answer yourself.

Why did my DataAnnotation core assessment disappear? ▼

Workers report it as part of the waiting period, with no known fix. Some see the Core open with no tasks left, some find the link loops back to the thank-you page, and some find it gone overnight after passing the Starter. Keep your profile current and check the dashboard every few days.

Related guides

Is data annotation hard to get into?: why most applicants miss the rubric, and how to practice against one.

DataAnnotation empty dashboard explained: what to do when an accepted account stops getting work.

Is DataAnnotation legit?: payouts, support and who the platform suits.

DataAnnotation pay by category: the rate for each track.

DataAnnotation alternatives: platforms hiring the same kind of contributor.

Cite this page

"DataAnnotation Assessment: Starter, Core and the Wait After", aitrainer.work, aitrainer.work/guides/dataannotation-assessment-what-to-expect

Pietro Romeo, founder of aitrainer.work

Pietro Romeo

MSc Human-Computer Interaction | Founder

Pietro Romeo is the founder of aitrainer.work. He writes and checks the guides, and runs the Academy and the certification exam.

Comments

Loading comments…
💬

Share your thoughts on this guide

Sign in to join the discussion.

Sign in to comment

Last updated: October 4, 2026