Explainable Uncertainty Estimation for Reliable Medical AI

WANG, Li Rong, DUELL, Jamie, XU, Xinran, HENDERSON, Thomas C, HEW, Yu Yue, CHIANG, Pik Wan Erica, ANG, Xiao Wei Al'star, FAN, Bingwen Eugene and FAN, Xiuyi (2026). Explainable Uncertainty Estimation for Reliable Medical AI. In: IEEE International Conference on Data Mining (ICDM) 2026, Shenyang, China, 12-15 Nov 2026. [Conference or Workshop Item]

Documents
37850:1369205
[thumbnail of ICDM2026_Explainable_Uncertainty_Estimation_AAM_ (1).pdf]
PDF
ICDM2026_Explainable_Uncertainty_Estimation_AAM_ (1).pdf - Accepted Version
Restricted to Repository staff only
Available under License All rights reserved.

Download (1MB)
Abstract
Artificial intelligence has strong potential to support clinical decision-making, yet its adoption in healthcare remains limited due to a lack of trust. Uncertainty estimation can signal unreliable predictions, and explainable AI (XAI) can clarify how predictions are made but existing methods treat them separately, providing no feature-level insight into why a prediction is uncertain or which tests to prioritize to reduce it. To address this gap, we propose explainable uncertainty estimation, which unifies uncertainty estimation and XAI to both quantify uncertainty and explain feature-level contributions. We introduce the Expected Gradients Reconstruction Uncertainty Estimate (egRUE), which incorporates prediction explanations into its uncertainty computation and decomposes uncertainty into feature-wise contributions. We prove theoretical properties of egRUE and show through experiments that it improves reliability and interpretability compared to existing methods. A user study with medical experts further demonstrates that egRUE's explanations improve calibrated trust over uncertainty scores alone, increasing confidence in correct predictions and reducing confidence in incorrect ones. By combining prediction uncertainty with feature-level explanations, egRUE strengthens decision-making support in safety-critical healthcare settings, clarifying both when predictions may be unreliable and which features drive that uncertainty.
More Information
Share
Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email

Actions (login required)

View Item View Item