Understanding Graph Neural Networks with Generalized Geometric Scattering Transforms
Document Type
Article
Publication Date
12-2023
Abstract
The scattering transform is a multilayered wavelet-based architecture that acts as a model of convolutional neural networks. Recently, several works have generalized the scattering transform to graph-structured data. Our work builds on these constructions by introducing windowed and nonwindowed geometric scattering transforms for graphs based on two very general classes wavelets, which are in most cases based on asymmetric matrices. We show that these transforms have many of the same theoretical guarantees as their symmetric counterparts. As a result, the proposed construction unifies and extends known theoretical results for many of the existing graph scattering architectures. Therefore, it helps bridge the gap between geometric scattering and other graph neural networks by introducing a large family of networks with provable stability and invariance guarantees. These results lay the groundwork for future deep learning architectures for graph-structured data that have learned filters and also provably have desirable theoretical properties.
Publication Information
Perlmutter, Michael; Tong, Alexander; Gao, Feng; Wolf, Guy; and Hirn, Matthew. (2023). "Understanding Graph Neural Networks with Generalized Geometric Scattering Transforms". SIAM Journal on Mathematics of Data Science, 5(4), 873-898. https://doi.org/10.1137/21M1465056