Domain Expert: Specialist Review for AI Training Data

About the work

Some tasks cannot be checked by a generalist. When AI training data or evaluation tasks involve finance, law, medicine, science or another specialist field, we bring in people who practise in that field to write and review the work.

How it works

You write tasks or reference answers in your field, or review model responses and existing answers for accuracy. You explain each judgement with evidence or reasoning a non-specialist reviewer can follow, and flag questions where experts could reasonably disagree.

Who this is for

Practising professionals and researchers with deep knowledge of a specific field. You can tell a correct answer from a plausible-sounding one, explain why, and keep your reasoning clear for readers outside your field.

What you’ll do

• Write domain-specific questions, tasks and reference answers
• Review model responses and existing answers for factual and technical accuracy
• Explain each decision with evidence or clear reasoning
• Flag ambiguous questions and cases where experts could disagree
• Help reviewers understand domain conventions and common mistakes

Who should apply

• 2+ years of professional or research experience in your field
• A degree, certification or track record that shows your expertise
• Ability to explain specialist decisions in plain written English
• Attention to detail and consistency across many items

Contract & payment terms

• You will be engaged as an independent contractor, not as an employee.
• This is fully remote work, open to applicants in any location.
• Work is project-based. Availability varies, and an application does not guarantee an assignment.
• Pay, scope, review criteria and access are confirmed at onboarding, after you sign a Non-Disclosure Agreement (NDA) and an Independent Contractor Agreement (ICA).
• Please do not share confidential material from a current or former employer or client.