This remote project asks practicing physicians to review written clinical vignettes and the benchmark questions built from them for a medical AI evaluation. The focus is general and internal medicine, with checks on factual accuracy, answer correctness, and the quality of distractor answers. It suits clinicians who want flexible, project-based work alongside their practice.
Pay not disclosed
The platform does not publish the pay for this job.
Open to residents of: United Arab Emirates, Argentina, Bulgaria, Bahrain, Brazil, Canada, Chile, Colombia, Czechia, Egypt, United Kingdom, Hungary, Indonesia, Israel, India, Jamaica, Jordan, Japan, South Korea, Kuwait, Lebanon, Mexico, Malaysia, New Zealand, Oman, Peru, Philippines, Poland, Qatar, Romania, Saudi Arabia, Singapore, Slovakia, Türkiye, United States, South Africa.
You apply on Mindrift, the AI training platform run by Toloka: submit your application for the role, pass a qualification step, then work on projects that match your expertise.
Official posting: https://apply.workable.com/j/242B07E319
Last checked on November 5, 2026.
This project asks practicing physicians to review clinical vignettes used to benchmark medical AI systems. The work centers on general and internal medicine, checking whether each vignette, question, answer, and distractor is accurate and gradeable. It suits licensed, board-certified doctors who want part-time, project-based work.
Posted October 28, 2026
This project asks practicing physicians to review clinical vignettes and benchmark questions used to test medical AI systems. The work centers on general and internal medicine, covering diagnosis and treatment reasoning across many organ systems. It suits licensed physicians who can take on part-time, project-based assignments.
Posted October 28, 2026
This part-time remote role asks practising physicians to review and annotate clinical cases and AI-generated medical content so that models reason more accurately about medicine. It suits Korean-speaking doctors with clinical experience, ideally in general specialties, and no prior AI background is needed.
Posted October 14, 2026
Referral link to micro1's job list: search for this role there. Open this exact job
This role asks practicing physicians to judge how well health AI models handle diagnoses, clinical reasoning and care plans. The work is part-time and asynchronous, aimed at MDs and DOs who currently see patients in primary care, internal medicine or hospital-based specialties.
Posted October 8, 2026
This contract role is for physicians with inpatient or hospitalist experience who can judge the accuracy of hospital records. The work involves reviewing medical records, including FHIR data and clinical notes, so that AI systems for clinical documentation and decision support learn from reliable material. The physician also explains findings to project teams in written reports and discussions.
Posted October 20, 2026
Referral link to micro1's job list: search for this role there. Open this exact job
This remote project asks practicing hospitalists and family medicine physicians to judge how accurately clinical AI tools suggest diagnoses from patient charts. Participants read de-identified records, reach their own diagnosis, and then decide whether an AI model's proposed diagnoses are correct and clinically relevant. It suits licensed physicians with strong differential diagnosis skills who can commit at least five hours within a set window.
Posted October 9, 2026
