Neuroimaging AI Models Improve Significantly When Trained on Routine Health System Data

A study published in Nature Medicine finds that AI models for neuroimaging tasks — such as detecting brain abnormalities from MRI scans — perform substantially better when trained on data drawn from routine health system operations rather than curated research datasets. The key finding is that the diversity and scale of real-world clinical data, despite being noisier, yields models that generalize better to the actual patient populations clinicians encounter. For developers building medical AI, this is a methodologically significant result: it challenges the assumption that cleaner, more carefully labeled research data always produces better models, and suggests that partnerships with health systems for data access may be more valuable than previously assumed. The research also has implications for AI training data strategy more broadly — in domains where distribution shift between lab and deployment is large, training on messy real-world data may be the right call. This finding is likely to influence how healthcare AI companies structure their data acquisition and model validation pipelines.