OpenRecently verified

Licensed Physician - Medical AI Evaluation

  • Health & Medicine
  • Platform: Mindrift
  • Location: United States

Not sure this job fits you?

  • Add your resume and see every open Health & Medicine job scored against your background. Free.
  • Your profile is never sent to the platforms. You decide where to apply.
Add your resume

About this job

This project asks practicing physicians to review clinical vignettes written for testing AI systems. Contributors check accuracy, completeness, answer correctness and the quality of distractor answers, then write short rationales. It suits licensed clinicians with multi-system experience who can take on part-time, project-based assignments.

What you'll do

  • Evaluate clinical vignettes paired with a question, a proposed answer and a distractor answer.
  • Score the clinical reasoning quality of benchmark items.
  • Check that the reasoning chain reaches the answer from vignette facts alone.
  • Write short rationales for each reviewed item.

Requirements

Internal medicineClinical reasoningDifferential diagnosisEvidence-based guidelinesNext-step managementClinical vignette review
  • MD or DO

Pay

Pay not disclosed

The platform does not publish the pay for this job.

Location

Open to residents of: United States.

How to apply

You apply on Mindrift, the AI training platform run by Toloka: submit your application for the role, pass a qualification step, then work on projects that match your expertise.

All Mindrift jobs and how the platform works

Source

Official posting: https://apply.workable.com/j/7F43517691

Last checked on October 28, 2026.

Similar jobs

  • Health & Medicine
  • Platform: Mindrift
  • Location: United States

This is a part-time, remote project in which practicing physicians review clinical case vignettes and the question, proposed answer, and distractor answer attached to each one, to help test and improve AI systems. It is aimed at physicians with broad general and internal medicine experience who can judge diagnostic and treatment reasoning.

Posted October 20, 2026

OpenRecently verifiedPay not disclosed
  • Health & Medicine
  • Platform: Mindrift
  • Location: United States

This remote project asks practicing internal medicine physicians to review clinical case vignettes built to test medical AI systems. The work covers checking vignette accuracy, answer correctness, and the reasoning behind each benchmark question. It suits physicians with broad multi-system clinical experience who can take on part-time, project-based assignments.

Posted October 19, 2026

OpenRecently verifiedPay not disclosed
  • Health & Medicine
  • Platform: micro1
  • Location: 58 countries
  • Language: Korean

This part-time remote role asks practising physicians to review and annotate clinical cases and AI-generated medical content so that models reason more accurately about medicine. It suits Korean-speaking doctors with clinical experience, ideally in general specialties, and no prior AI background is needed.

Posted October 14, 2026

OpenRecently verifiedPay not disclosed

Referral link to micro1's job list: search for this role there. Open this exact job

  • Health & Medicine
  • Platform: Mercor
  • Location: United States

This role asks practicing physicians to judge how well health AI models handle diagnoses, clinical reasoning and care plans. The work is part-time and asynchronous, aimed at MDs and DOs who currently see patients in primary care, internal medicine or hospital-based specialties.

Posted October 8, 2026

OpenRecently verified$150/hr

Referral link: we may earn a fee. Apply without it

  • Health & Medicine
  • Platform: micro1
  • Location: 58 countries

This contract role is for physicians with inpatient or hospitalist experience who can judge the accuracy of hospital records. The work involves reviewing medical records, including FHIR data and clinical notes, so that AI systems for clinical documentation and decision support learn from reliable material. The physician also explains findings to project teams in written reports and discussions.

Posted October 20, 2026

OpenRecently verified$100-115/hr

Referral link to micro1's job list: search for this role there. Open this exact job

  • Health & Medicine
  • Platform: Terac
  • Location: United States

This remote project asks practicing hospitalists and family medicine physicians to judge how accurately clinical AI tools suggest diagnoses from patient charts. Participants read de-identified records, reach their own diagnosis, and then decide whether an AI model's proposed diagnoses are correct and clinically relevant. It suits licensed physicians with strong differential diagnosis skills who can commit at least five hours within a set window.

Posted October 9, 2026

Keep exploring