Seismic Foundation Model (SFM): a next generation deep learning model in geophysics
Abstract
While computer science has seen remarkable advancements in foundation models, they remain underexplored in geoscience. Addressing this gap, we introduce a workflow to develop geophysical foundation models, including data preparation, model pre-training, and adaption to downstream tasks. From 192 globally collected 3-D seismic volumes, we create a carefully curated dataset of 2,286,422 2-D seismic images. Fully using these unlabeled images, we employ the self-supervised learning to pre-train a Transformer-based Seismic Foundation Model (SFM) for producing all-purpose seismic features that work across various tasks and surveys. Through experiments on seismic facies classification, geobody identification, interpolation, denoising, and inversion, our pre-trained model demonstrates versatility, generalization, scalability, and superior performance over baseline models. In conclusion, we provide a foundation model and vast dataset to advance AI in geophysics, addressing challenges (poor generalization, lacking labels, and repetitive training for task-specified models) of applying AI in geophysics and paving the way for future innovations in geoscience.
Read the paper
Related studies
- Current state and future directions for deep learning based automatic seismic fault interpretation: A systematic review
- Physics of Partially Saturated Porous Media: Residual Saturation and Seismic-Wave Propagation
- Modern Imaging Using Seismic Reflection Data
- Effects of marine seismic surveys on free-ranging fauna: a systematic literature review
- A review of the recent seismic activity in the southern part of egypt (upper egypt)
- A review of research on mechanism of seismic attenuation and energy compensation
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.