Combining chest X-RAY and clinical covariates for osteoporosis screening: a multimodal deep learning approach
Abstract
ABSTRACT: Osteoporosis is a major global health concern, yet screening remains inaccessible in many economically challenged and low-resource settings due to the high cost and operational complexity the gold standard Dual-energy X-ray Absorptiometry (DXA) scan requires. This study presents a multimodal deep-learning approach for opportunistic osteoporosis screening using chest X-rays and clinical variables such as age and gender. A total of 406 samples were retrospectively collected from a national hospital, comprising annotated chest radiographs paired with their DXA results from patients 50 and above. Two convolutional neural network (CNN) architectures, ResNet50 and EfficientNetb3, were deployed under three configurations: image-only, early fusion, and late fusion. Image preprocessing includes CLAHE+Gamma Correction, followed by resizing, local regions of interest (ROI) extraction, and augmentation. The multimodal integration was conducted via early fusion (pixel-level) and late fusion (feature-level), with clinical variables normalized and encoded into a 1×3 vector. A custom Residual MLP classifier was employed in the late fusion models. Hyperparameter tuning was performed using Optuna’s Bayesian optimization. Evaluation metrics included Accuracy, AUC, Precision, Recall, Sensitivity, and F1 Score. Among all models, Late Fusion EfficientNetb3 achieved the best performance on the global chest X-ray, with an AUC of 72.73%. Moreover, EfficientNetb3 consistently outperformed…
Read the paper
Related studies
- The potential and limitations of neutrons, electrons and X-rays for atomic resolution microscopy of unstained biological molecules
- X-ray-Computed Tomography Contrast Agents
- Reactivity of Surface Species in Heterogeneous Catalysts Probed by In Situ X-ray Absorption Techniques
- Single-crystal X-ray diffraction studies on structural transformations of porous coordination polymers
- Investigation of solid/vapor interfaces using ambient pressure X-ray photoelectron spectroscopy
- Resonant X-Ray Scattering Studies of Charge Order in Cuprates
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.