This project asks practicing physicians to review clinical case vignettes written for evaluating medical AI systems. The work involves judging whether each vignette, question, correct answer and decoy answer are accurate, complete and fair, and writing short rationales. It suits board-certified or residency-trained clinicians with recent patient care and broad multi-system experience.
Pay not disclosed
The platform does not publish the pay for this job.
Open to residents of: United States.
You apply on Mindrift, the AI training platform run by Toloka: submit your application for the role, pass a qualification step, then work on projects that match your expertise.
Official posting: https://apply.workable.com/j/01E04A9C9B
Last checked on October 14, 2026.
This project-based remote role asks practicing physicians to review clinical case vignettes written for AI benchmark items. The work covers checking vignette accuracy, answer correctness, distractor quality, and whether each reasoning chain follows from the case facts, followed by short written rationales. It is aimed at physicians with broad, multi-system general or internal medicine experience.
Posted October 12, 2026
This project-based role asks practicing physicians to review clinical case vignettes used to test medical AI systems. The work centers on general and internal medicine, covering diagnosis and treatment questions across many organ systems. It suits licensed doctors who can give part-time hours to independent review and written rationales.
Posted October 9, 2026
This role asks practicing physicians to judge how well health AI models handle diagnoses, clinical reasoning and care plans. The work is part-time and asynchronous, aimed at MDs and DOs who currently see patients in primary care, internal medicine or hospital-based specialties.
Posted October 8, 2026
This remote project asks practicing hospitalists and family medicine physicians to judge how accurately clinical AI tools suggest diagnoses from patient charts. Participants read de-identified records, reach their own diagnosis, and then decide whether an AI model's proposed diagnoses are correct and clinically relevant. It suits licensed physicians with strong differential diagnosis skills who can commit at least five hours within a set window.
Posted October 9, 2026
This part-time contract asks physicians to review clinical cases, patient data, and AI-generated medical content, giving expert feedback that helps train AI systems supporting medical decisions. It is aimed at practicing doctors, especially those from general specialties such as internal medicine, family practice, or emergency medicine. No prior AI experience is needed, since clinical knowledge is the main requirement.
Posted October 6, 2026
Referral link to micro1's job list: search for this role there. Open this exact job
Mercor is recruiting experienced nurse practitioners to evaluate and improve cutting-edge AI systems in healthcare. You will analyze clinical content generated by AI, treatment plans and patient education materials by leveraging your real-world expertise in diagnosing, treating and managing patients with acute and chronic conditions.
Posted August 21, 2026
