$40-125/hrAs published by the platform.
A physician evaluates AI model responses on clinical questions against current standards of care, identifying unsafe or outdated guidance and writing correct clinical answers when needed. This role requires assessing AI clinical reasoning and creating prompts that test differential diagnosis, treatment planning, and patient communication.
$40-125/hr
Pay as published by the platform. It is not a guarantee of income or hours.
The platform has not published which countries are eligible for this job.
You apply on DataAnnotation: create an account, take the qualification assessment for your field, then pick up paid projects when you qualify.
Official posting: https://www.dataannotation.tech/job-board/physician
Last checked on October 8, 2026.
This remote, hourly contract asks you to review and grade AI-generated content about healthcare data, electronic health record systems, and clinical workflows. The work helps AI labs make their models more accurate on medical information. It suits health informatics professionals who can judge clinical and technical accuracy and explain their feedback in writing.
This remote contract role asks public health graduates to bring their domain knowledge to AI training. The work involves building realistic population health scenarios, writing evidence-based reference answers, and reviewing AI-generated health advice for accuracy, logic, bias, and ethics. It suits independent, self-directed specialists who can explain health data clearly, and no prior AI experience is required.
This role involves evaluating how well AI models reason through cardiology cases, identifying errors in clinical judgment that could harm patients. Cardiologists will write prompts to test AI reasoning, review AI outputs for accuracy against current guidelines, and provide correct answers when the model errs, serving as the training signal for AI improvement.
This role involves evaluating AI-generated responses to health and medical questions for clinical accuracy and safety. The expert identifies errors in reasoning, missed contraindications, unsafe advice, and writes correct answers grounded in current clinical practice, ensuring AI models provide guidance that real clinicians would trust.
This role asks practicing physicians to judge how well health AI models handle diagnoses, clinical reasoning and care plans. The work is part-time and asynchronous, aimed at MDs and DOs who currently see patients in primary care, internal medicine or hospital-based specialties.
Posted October 8, 2026
This short-term remote project asks practicing oncologists to test how frontier AI models reason through real-world cases, with a focus on clinical trial design, patient eligibility and treatment decisions. Contributors write challenging scenarios, judge model answers against current standard-of-care guidelines, and flag errors or unsafe advice. It suits clinicians with fellowship training and hands-on clinical trial experience who want to apply their expertise to AI research.
Posted October 8, 2026
