This project-based remote role asks practicing physicians to review clinical case vignettes written for AI benchmark items. The work covers checking vignette accuracy, answer correctness, distractor quality, and whether each reasoning chain follows from the case facts, followed by short written rationales. It is aimed at physicians with broad, multi-system general or internal medicine experience.
Pay not disclosed
The platform does not publish the pay for this job.
Open to residents of: United States.
You apply on Mindrift, the AI training platform run by Toloka: submit your application for the role, pass a qualification step, then work on projects that match your expertise.
Official posting: https://apply.workable.com/j/F372E025ED
Last checked on October 13, 2026.
This project-based role asks practicing physicians to review clinical case vignettes used to test medical AI systems. The work centers on general and internal medicine, covering diagnosis and treatment questions across many organ systems. It suits licensed doctors who can give part-time hours to independent review and written rationales.
Posted October 9, 2026
This project asks practicing physicians to review clinical case vignettes, with their questions and answer options, for a medical AI evaluation program. The work centers on general and internal medicine and checks whether each item is accurate, gradeable, and free of giveaways. It suits clinicians who can take on part-time, project-based assignments.
Posted October 9, 2026
This role asks practicing physicians to judge how well health AI models handle diagnoses, clinical reasoning and care plans. The work is part-time and asynchronous, aimed at MDs and DOs who currently see patients in primary care, internal medicine or hospital-based specialties.
Posted October 8, 2026
This remote project asks practicing hospitalists and family medicine physicians to judge how accurately clinical AI tools suggest diagnoses from patient charts. Participants read de-identified records, reach their own diagnosis, and then decide whether an AI model's proposed diagnoses are correct and clinically relevant. It suits licensed physicians with strong differential diagnosis skills who can commit at least five hours within a set window.
Posted October 9, 2026
This part-time contract asks physicians to review clinical cases, patient data, and AI-generated medical content, giving expert feedback that helps train AI systems supporting medical decisions. It is aimed at practicing doctors, especially those from general specialties such as internal medicine, family practice, or emergency medicine. No prior AI experience is needed, since clinical knowledge is the main requirement.
Posted October 6, 2026
Referral link to micro1's job list: search for this role there. Open this exact job
Mercor is recruiting experienced nurse practitioners to evaluate and improve cutting-edge AI systems in healthcare. You will analyze clinical content generated by AI, treatment plans and patient education materials by leveraging your real-world expertise in diagnosing, treating and managing patients with acute and chronic conditions.
Posted August 21, 2026
