Academic

Unveiling the Mechanism of Continuous Representation Full-Waveform Inversion: A Wave Based Neural Tangent Kernel Framework

arXiv:2603.22362v1 Announce Type: new Abstract: Full-waveform inversion (FWI) estimates physical parameters in the wave equation from limited measurements and has been widely applied in geophysical exploration, medical imaging, and non-destructive testing. Conventional FWI methods are limited by their notorious sensitivity to the accuracy of the initial models. Recent progress in continuous representation FWI (CR-FWI) demonstrates that representing parameter models with a coordinate-based neural network, such as implicit neural representation (INR), can mitigate the dependence on initial models. However, its underlying mechanism remains unclear, and INR-based FWI shows slower high-frequency convergence. In this work, we investigate the general CR-FWI framework and develop a unified theoretical understanding by extending the neural tangent kernel (NTK) for FWI to establish a wave-based NTK framework. Unlike standard NTK, our analysis reveals that wave-based NTK is not constant, both at

R
Ruihua Chen, Yisi Luo, Bangyu Wu, Deyu Meng
· · 1 min read · 3 views

arXiv:2603.22362v1 Announce Type: new Abstract: Full-waveform inversion (FWI) estimates physical parameters in the wave equation from limited measurements and has been widely applied in geophysical exploration, medical imaging, and non-destructive testing. Conventional FWI methods are limited by their notorious sensitivity to the accuracy of the initial models. Recent progress in continuous representation FWI (CR-FWI) demonstrates that representing parameter models with a coordinate-based neural network, such as implicit neural representation (INR), can mitigate the dependence on initial models. However, its underlying mechanism remains unclear, and INR-based FWI shows slower high-frequency convergence. In this work, we investigate the general CR-FWI framework and develop a unified theoretical understanding by extending the neural tangent kernel (NTK) for FWI to establish a wave-based NTK framework. Unlike standard NTK, our analysis reveals that wave-based NTK is not constant, both at initialization and during training, due to the inherent nonlinearity of FWI. We further show that the eigenvalue decay behavior of the wave-based NTK can explain why CR-FWI alleviates the dependency on initial models and shows slower high-frequency convergence. Building on these insights, we propose several CR-FWI methods with tailored eigenvalue decay properties for FWI, including a novel hybrid representation combining INR and multi-resolution grid (termed IG-FWI) that achieves a more balanced trade-off between robustness and high-frequency convergence rate. Applications in geophysical exploration on Marmousi, 2D SEG/EAGE Salt and Overthrust, 2004 BP model, and the more realistic 2014 Chevron models show the superior performance of our proposed methods compared to conventional FWI and existing INR-based FWI methods.

Executive Summary

The article presents an in-depth analysis of the continuous representation full-waveform inversion (CR-FWI) framework, specifically focusing on the neural tangent kernel (NTK) method for a unified understanding of its underlying mechanism. The authors develop a wave-based NTK framework that explains the eigenvalue decay behavior and its implications on the CR-FWI's performance. The proposed framework, incorporating implicit neural representation (INR) and multi-resolution grid (IG-FWI), demonstrates improved performance in geophysical exploration applications. This study sheds new light on the CR-FWI mechanism and provides novel insights for its development and application. The findings and proposed methods have the potential to enhance the robustness and efficiency of FWI in various fields.

Key Points

  • The authors develop a wave-based NTK framework to understand the CR-FWI mechanism
  • The framework explains the eigenvalue decay behavior and its impact on CR-FWI's performance
  • A novel hybrid representation (IG-FWI) is proposed, combining INR and multi-resolution grid
  • The proposed methods demonstrate improved performance in geophysical exploration applications

Merits

Strength of theoretical foundation

The study provides a comprehensive theoretical understanding of the CR-FWI mechanism, establishing a solid foundation for further research and development.

Improved practical performance

The proposed methods demonstrate superior performance in geophysical exploration applications, highlighting the practical significance of the study's findings.

Demerits

Computational complexity

The wave-based NTK framework may introduce additional computational complexity, potentially limiting its practical application in real-world scenarios.

Generalizability to other fields

The study focuses primarily on geophysical exploration; further research is needed to determine the generalizability of the proposed framework to other fields, such as medical imaging or non-destructive testing.

Expert Commentary

The study provides a significant contribution to the field of inverse problems and machine learning, shedding new light on the CR-FWI mechanism and its underlying theoretical framework. The proposed wave-based NTK framework demonstrates a deeper understanding of the CR-FWI's behavior and its implications for practical applications. The findings and proposed methods have the potential to enhance the efficiency and robustness of full-waveform inversion in various fields, making this study a valuable addition to the existing literature.

Recommendations

  • Further research is needed to explore the generalizability of the proposed framework to other fields beyond geophysical exploration.
  • The study's findings and proposed methods should be tested in real-world scenarios to evaluate their practical performance and scalability.

Sources

Original: arXiv - cs.LG