Physician Reviewer (MD/DO) - Medical AI Evaluation

About the company Paid per approved task, about $100/hr equivalent. One flat rate for every approved task.

About the role

About the company

Paid per approved task, about $100/hr equivalent. One flat rate for every approved task.

Built to fit around a clinical practice:

Tasks estimated at about 10–20 hrs/week while the project is active; you choose when and how much to contribute

Contribute anytime, from anywhere

No patient contact, no malpractice exposure: you review written clinical cases

All reviewers are license-verified physicians

$50 one-time onboarding reward, paid once your first production task is approved

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based.

What this opportunity involves

We’re looking for actively practicing physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the main focus. On this project, contributors may:

Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;

Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;

Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales;

Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You’re improving the AI tools you’ll eventually use yourself.

If you’re a practicing physician ready to take on this challenging and engaging project, apply to take part!

What we look for …

Official source: apply.workable.com. Details can change; the platform's page is the final word. How we check listings.