OpenRecently verified

Hospitalist / Internist - Medical AI Evaluation (Remote, Part-Time)

  • Health & Medicine
  • Platform: Mindrift
  • Location: United States

About this job

This is a part-time, remote project in which practicing physicians review clinical case vignettes and the question, proposed answer, and distractor answer attached to each one, to help test and improve AI systems. It is aimed at physicians with broad general and internal medicine experience who can judge diagnostic and treatment reasoning.

What you'll do

  • Assess clinical vignettes and their paired questions, answers, and distractors for accuracy and gradeability.
  • Score the clinical reasoning quality of benchmark items, including whether the vignette gives away the answer.
  • Check that each reasoning chain reaches the answer from vignette facts and write short rationales.
  • Complete independent blind reads followed by physician adjudication.

Requirements

Internal medicineGeneral medicineClinical reasoningDifferential diagnosisEvidence-based guidelinesHospital medicine
  • MD or DO

Pay

Pay not disclosed

The platform does not publish the pay for this job.

Location

Open to residents of: United States.

How to apply

You apply on Mindrift, the AI training platform run by Toloka: submit your application for the role, pass a qualification step, then work on projects that match your expertise.

All Mindrift jobs and how the platform works

Source

Official posting: https://apply.workable.com/j/CFD18E71E5

Last checked on October 21, 2026.

Similar jobs

  • Health & Medicine
  • Platform: micro1
  • Location: 58 countries
  • Language: Korean

This part-time remote role asks practising physicians to review and annotate clinical cases and AI-generated medical content so that models reason more accurately about medicine. It suits Korean-speaking doctors with clinical experience, ideally in general specialties, and no prior AI background is needed.

Posted October 14, 2026

OpenRecently verifiedPay not disclosed

Referral link to micro1's job list: search for this role there. Open this exact job

  • Health & Medicine
  • Platform: Mindrift
  • Location: United States

This project-based role asks practicing physicians to review clinical case vignettes used to test medical AI systems. The work centers on general and internal medicine, covering diagnosis and treatment questions across many organ systems. It suits licensed doctors who can give part-time hours to independent review and written rationales.

Posted October 9, 2026

OpenRecently verifiedPay not disclosed
  • Health & Medicine
  • Platform: Mindrift
  • Location: United States

This remote project asks practicing internal medicine physicians to review clinical case vignettes built to test medical AI systems. The work covers checking vignette accuracy, answer correctness, and the reasoning behind each benchmark question. It suits physicians with broad multi-system clinical experience who can take on part-time, project-based assignments.

Posted October 19, 2026

OpenRecently verifiedPay not disclosed
  • Health & Medicine
  • Platform: micro1
  • Location: 58 countries
  • Language: Japanese

This contract role asks practising physicians to review and annotate clinical cases and medical content so that AI systems give medically accurate answers. It suits doctors with recent clinical experience who are fluent in Japanese and English. The work is part-time and fully remote.

Posted October 14, 2026

OpenRecently verifiedPay not disclosed

Referral link to micro1's job list: search for this role there. Open this exact job

  • Health & Medicine
  • Platform: Mercor
  • Location: United States

This role asks practicing physicians to judge how well health AI models handle diagnoses, clinical reasoning and care plans. The work is part-time and asynchronous, aimed at MDs and DOs who currently see patients in primary care, internal medicine or hospital-based specialties.

Posted October 8, 2026

OpenRecently verified$150/hr

Referral link: we may earn a fee. Apply without it

  • Health & Medicine
  • Platform: Mercor
  • Location: United States

This part-time remote role asks a physician with a pediatric emergency or urgent care background to review clinical documentation and patient charts for accuracy, completeness and clinical soundness. The work also involves checking AI-generated clinical summaries and giving structured written feedback that product teams can act on. It suits clinicians who want to keep an active practice while helping shape medical AI tools.

Posted October 14, 2026

OpenRecently verified$150-170/hr

Referral link: we may earn a fee. Apply without it

Keep exploring