83%: Microsoft’s AI Panel Outperforms Doctors in Complex Medical Simulations

Microsoft AI has entered the high-stakes race for medical dominance, reporting that its new diagnostic system, MAI-DxO, correctly identified complex cases with an 83% accuracy rate. This result, published in Science on Thursday, more than doubles the 36% accuracy achieved by generalist physicians working individually with reference materials. Mustafa Suleyman, CEO of Microsoft AI, framed the achievement as a critical step toward achieving 'medical superintelligence,' a goal that positions the company against rivals like Google and OpenAI.

The system operates by coordinating multiple AI agents that mimic a panel of doctors. These agents collaboratively question patients, order tests, and debate diagnoses. The simulation utilized difficult cases from the New England Journal of Medicine. While the study noted that such complex cases are typically handled by specialists or teams rather than individual generalists, the significant gap in accuracy highlights the potential of AI orchestration to enhance diagnostic capability.

Dominic King, vice president of Health at Microsoft AI, emphasized the urgency of the technology. 'There is something very substantial and exciting here,' King stated. He identified the growing mismatch between the supply of medical expertise and patient demand as the primary challenge currently facing healthcare delivery, suggesting that AI could help bridge this gap.

The study’s data indicates that much of the performance improvement stems from underlying model power, with Microsoft’s orchestration adding incremental gains. Testing across models from OpenAI, Google, Anthropic, Meta, and DeepSeek showed that the best results came from OpenAI’s GPT-5 and GPT-5.5. While DxO reduced costs and improved accuracy on complex cases, particularly with less capable models like Gemini 2.5 Flash, the benefits were minimal for emergency department cases where baseline accuracy was already high.

Looking ahead, Suleyman revealed that Microsoft is partnering with the Mayo Clinic to train a healthcare-specific foundation model, with a release planned for next year. He predicts a 'coding style breakthrough' for medical records by 2027, allowing for highly accurate predictions of how medical records might unfold. Suleyman, a co-founder of DeepMind who joined Microsoft in 2024, believes healthcare models will become 'an order of magnitude better' within the next two to three years.

To validate these capabilities in the real world, Microsoft is launching a partnership with Beth Israel Deaconess Medical Center in Boston. The study will evaluate DxO’s clinical reasoning across various hospital settings, comparing its recommendations against human doctors in parallel. King described the initiative as potentially the largest of its kind, aiming to provide compelling evidence for the large-scale deployment of AI in urgent care and emergency environments.

Microsoft’s efforts coincide with the publication of a manifesto defining medical superintelligence as the ability to surpass human-led systems in reasoning and coordination across the full arc of care. The company aims to move beyond simple benchmarking to deep integration with clinicians. With existing dictation and radiology tools already in market, Suleyman stated that securing the 'number one state-of-the-art' clinical decision support product is a key differentiator for Microsoft in the frontier AI race.