Artificial Intelligence Echocardiographic Interpretation in the Emergency Department: Agreement, Interpretation Yield and Reporting Scope
Abstract
ABSTRACT Objective To assess the agreement between artificial intelligence (AI) interpretation and expert emergency physician sonologist review of echocardiograms performed in the Emergency Department (ED). Methods Retrospective multicentre agreement study in four Australian EDs. A total of 195 echocardiograms (2016–2023) underwent three‐stage adjudicated human expert review. Human reports were compared with us2.ai reports. Agreement across 10 validated parameters was reported as percentage exact match with 95% confidence intervals and kappa under two pre‐specified tiers: Guideline Compliant (GC; ASE/EACVI multi‐view criteria) and Pragmatic (PR; any available measurement). Reference standard reliability was quantified. Results Pooled agreement was 76% at both tiers (GC n = 875; PR n = 1323); AI returned an interpretation in 46% of evaluations at GC and 70% at PR. Four structural parameters reached 78%–87%: right atrial size 87% (κ = 0.62), right ventricular (RV) contractility 83% (κ = 0.42), left ventricular (LV) size 83% (κ = 0.52) and RV size 78% (κ = 0.37). Binary LV systolic agreement was 79% GC and 83% PR. Expert reviewers agreed on 85% of interpretations. Pericardial effusion, aortic regurgitation and mitral stenosis, present in 7%–20% of patients, are not reported in the current us2.ai algorithm. Conclusion AI agreed with expert review in about three‐quarters of evaluations but provided a guideline‐compliant interpretation in less than half; a pragmatic approach…
Read the paper
Related studies
- The Matrisome: In Silico Definition and In Vivo Characterization by Proteomics of Normal and Tumor Extracellular Matrices
- The Escherichia coli MG1655 in silico metabolic genotype: Its definition, characteristics, and capabilities
- In silico pharmacology for drug discovery: methods for virtual ligand screening and profiling
- In silico prediction of splice-altering single nucleotide variants in the human genome
- In silico clinical trials: how computer simulation will transform the biomedical industry
- In silico optimization of a guava antimicrobial peptide enables combinatorial exploration for peptide design
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.