Fault detection in seismic data using a true 3D global attention convolutional network with self-supervised denoising pretext training
Abstract
Accurate fault detection in 3D seismic data requires modeling extended geological structures across multiple dimensions. Recent CNN-transformer hybrids employ windowed attention (Swin Transformer) or factorized attention, fragmenting volumetric fault geometries into constrained local interactions that cannot fully capture continuous fault planes. Additionally, models frequently misclassify seismic noise as faults due to limited labeled data and insufficient noise exposure. We present the first application of unfactorized 3D global attention—where every voxel attends to all other voxels—integrated with volumetric convolution for seismic fault segmentation. Building on Mahzad et al. (2026), our hybrid U-Net combines 3D convolution for local features with true global self-attention for complete spatial context. Training employs two-stage learning: self-supervised denoising pretext training across multiple real-world 3D surveys, then discriminative transfer learning on fault-labeled data using layer-wise learning rate decay and Unified Focal Loss. Validation on Thebe survey data achieved Dice = 0.853, IoU = 0.744, precision = 0.842, MCC = 0.841—statistically significant improvements (p < 0.001, Cohen’s d = 0.54–1.02) of 4.5–8.1% over state-of-the-art 3D CNN+Swin architecture. On unseen test data, improvements widened to 9.9–16.7% with superior generalization (3.6% vs. 8.3% degradation). Results establish that unfactorized global attention with noise-aware pretext training…
Read the paper
Related studies
- Current state and future directions for deep learning based automatic seismic fault interpretation: A systematic review
- Physics of Partially Saturated Porous Media: Residual Saturation and Seismic-Wave Propagation
- Modern Imaging Using Seismic Reflection Data
- Effects of marine seismic surveys on free-ranging fauna: a systematic literature review
- A review of the recent seismic activity in the southern part of egypt (upper egypt)
- A review of research on mechanism of seismic attenuation and energy compensation
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.