SeisCoDE: 3D Seismic Interpretation Foundation Model with Contrastive Self-Distillation Learning
Abstract
Seismic interpretation is vital for understanding subsurface structures but remains labor-intensive, subjective, and computationally demanding. While deep learning (DL) offers promise, its success hinges on large, high-quality datasets, often scarce in geophysics. Foundation Models (FMs), which have shown significant success in fields like natural language processing and computer vision, offer a transformative opportunity for seismic interpretation by enabling knowledge transfer and generalization across interpretation tasks. However, the application of FMs in this domain remains limited, especially at the 3D scale, due to the absence of a domain-specific pretraining workflow. Here, our study sought to develop a pretraining strategy for 3D seismic interpretation by introducing a vision transformer-based Seismic Contrastive Self-Distillation Encoder (SeisCoDE), a novel self-supervised learning (SSL) framework that leverages seismic signal processing and attribute analysis, preserving seismic structural integrity during pretraining. By leveraging contrastive learning and self-distillation, SeisCoDE learns meaningful latent representations without the need for labeled data (zero-shot approach). Results indicate that SeisCoDE effectively captures critical seismic features and characteristics, producing robust latent feature representations that drive downstream seismic interpretation. It demonstrates enhanced generalization abilities across different seismic interpretation…
Read the paper
Related studies
- Current state and future directions for deep learning based automatic seismic fault interpretation: A systematic review
- Physics of Partially Saturated Porous Media: Residual Saturation and Seismic-Wave Propagation
- Modern Imaging Using Seismic Reflection Data
- Effects of marine seismic surveys on free-ranging fauna: a systematic literature review
- A review of the recent seismic activity in the southern part of egypt (upper egypt)
- A review of research on mechanism of seismic attenuation and energy compensation
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.