AI alignment in medical imaging: Unveiling hidden biases through counterfactual analysis
Abstract
Machine learning (ML) systems for medical imaging have demonstrated remarkable diagnostic capabilities. However, their susceptibility to learning spurious correlations with sensitive attributes poses significant risks to fairness and safety. In this paper, we introduce a novel statistical framework to evaluate the dependency of medical imaging ML models on sensitive attributes, such as demographics. Our method leverages the concept of counterfactual invariance, measuring the extent to which a model's predictions remain unchanged under hypothetical changes to sensitive attributes. We present a practical algorithm that combines conditional latent diffusion models with statistical hypothesis testing to identify and quantify such biases without requiring direct access to counterfactual data. On synthetic benchmarks, our framework correctly identifies 96.1% of biased models while producing false alarms on 22.0% of fair models. On two real-world chest X-ray datasets, CheXpert and MIMIC-CXR, it detects bias at average rates 96.3%, 95.7% across all diagnostic tasks when models are strongly biased, and its average false alarm rate drops to 15.3%, 14.7%, respectively, for the least biased models, consistently outperforming existing fairness baselines and demonstrating strong alignment with counterfactual fairness principles.
Read the paper
Related studies
- Learning from First-Generation Qualitative Approaches in the IS Discipline: An Evolutionary View and Some Implications for Authors and Evaluators (PART 1/2)
- Commentary on the clinical and preclinical dosage limits of interstitially administered magnetic fluids for therapeutic hyperthermia based on current practice and efficacy models
- Prosthesis: New Technological Opportunities and Innovative Biomedical Devices
- The history and future of neural modeling for cochlear implants
- Ryanodine receptors: waking up from refractoriness
- Novel Transgenic Rabbit Model Sheds Light on the Puzzling Role of Matrix Metalloproteinase-12 in Atherosclerosis
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.