Comparative Analysis of Clinical Finding Retrieval Difficulty in Chest X-ray Retrieval Models
Abstract
Abstract Automated chest X-ray (CXR) report generation increasingly relies on retrieval-based systems that select sentences from fixed candidate pools of clinical language. Because these pools may be unevenly distributed across clinical findings, this study investigated whether candidate-pool composition affects finding-level retrieval performance and cross-model agreement on relative finding difficulty. Three sentence-level image-to-text retrieval models, a proposed model based on the JoImTeRNet framework, CXR-RePaiR, and CXR-ReDonE, were evaluated using finding-level recall, precision, and F1 at K=1, 5, and 10 under two candidate-pool conditions. The original pool contained 129,906 sentences from the MIMIC-CXR findings sections, while a balanced, reduced-size candidate pool capped positive sentences per finding at 450, yielding 6,216 sentences. Cross-model agreement in finding difficulty was assessed using Spearman rank correlation with paired bootstrap testing. Overall recall ranged from 0.09 to 0.31 and precision from 0.15 to 0.29 across models and K values. Lung Opacity and Pleural Effusion were consistently among the most difficult findings to retrieve, whereas Support Devices was consistently among the easiest. Under the original pool, cross-model agreement on finding difficulty was strong (ρ=0.749–0.807) but decreased markedly under the balanced pool (ρ=0.240–0.495), with significant reductions for all model pairs (∆ρ=0.298–0.487, all p
Read the paper
Related studies
- The potential and limitations of neutrons, electrons and X-rays for atomic resolution microscopy of unstained biological molecules
- X-ray-Computed Tomography Contrast Agents
- Reactivity of Surface Species in Heterogeneous Catalysts Probed by In Situ X-ray Absorption Techniques
- Single-crystal X-ray diffraction studies on structural transformations of porous coordination polymers
- Investigation of solid/vapor interfaces using ambient pressure X-ray photoelectron spectroscopy
- Resonant X-Ray Scattering Studies of Charge Order in Cuprates
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.