Researchers are developing a groundbreaking artificial intelligence system that could create a “virtual patient” to simulate how diseases progress and how treatments work, potentially slashing the time and cost of medical discovery. The approach uses multimodal generative AI to build digital twins from millions of patient records, imaging data, and genetic profiles, offering a new path forward for precision medicine.
Traditional clinical trials can take years and often exceed $100 million in costs. As medicine moves toward tailoring treatments for each individual, experts say the old model is unsustainable. The new AI technology aims to learn the “language of patients” by analyzing electronic health records, medical images, and multiomics data. The result is a virtual patient world model that can forecast disease progression and predict how a person might respond to a specific therapy. This could enable AI-powered virtual clinical trials using data from hundreds of millions of patients, in partnership with large health systems and life sciences companies.
Led by Hoifung Poon, General Manager of Real-World Evidence at Microsoft Research and an affiliated faculty member at the University of Washington Medical School, the team has already produced popular open-source foundation models including PubMedBERT, BioGPT, LLaVA-Med, and BiomedParse, which have been downloaded tens of millions of times. Recent publications in Nature and Cell feature digital pathology and spatial proteomics models such as GigaPath and GigaTIME. These AI systems are already in daily use for applications like molecular tumor boards and clinical trial matching.
The next step involves deepening partnerships with real-world stakeholders to validate and deploy the technology. By synthesizing evidence across massive datasets, the virtual patient model could help researchers test new treatments faster and more safely, bringing precision health from concept to reality. For patients, this could mean quicker access to therapies designed specifically for their unique biology.