LGJan 5, 2022

Neural Architecture Search for Inversion

arXiv:2201.01772v11 citations
AI Analysis

This work addresses inversion problems in domains like geophysics by incrementally improving loss functions and architecture selection.

The paper tackles inversion problems by extending existing deep learning frameworks through a more appropriate loss function and neural architecture search, showing improved performance in capturing high-level features and optimizing network structures for inversion tasks.

Over the year, people have been using deep learning to tackle inversion problems, and we see the framework has been applied to build relationship between recording wavefield and velocity (Yang et al., 2016). Here we will extend the work from 2 perspectives, one is deriving a more appropriate loss function, as we now, pixel-2-pixel comparison might not be the best choice to characterize image structure, and we will elaborate on how to construct cost function to capture high level feature to enhance the model performance. Another dimension is searching for the more appropriate neural architecture, which is a subset of an even bigger picture, the automatic machine learning, or AutoML. There are several famous networks, U-net, ResNet (He et al., 2016) and DenseNet (Huang et al., 2017), and they achieve phenomenal results for certain problems, yet it's hard to argue they are the best for inversion problems without thoroughly searching within certain space. Here we will be showing our architecture search results for inversion.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes