Unrolling a Graph-Laplacian Denoiser Realizes Only Compositions of Polynomial Graph Filters
AuthorsSeyed Alireza Hosseini
Resources
The paper proves that an apparently powerful unrolled graph denoiser can only realize a narrow class of polynomial graph filters, limiting its expressive power and practical accuracy.
Key results
For K=10 and m=3, the unrolled output has degree at most 20.
The practical configuration reaches at most a 17-dimensional subset inside the 21-dimensional class P20.
Measured conditioning of the graph denoiser operator in the image-patch experiment.
Minimum K estimated for 10−2 relative accuracy when κ(Ψ)=107.
Test PSNR in dB using 17 learned parameters.
Test PSNR in dB using a direct degree-16 Bernstein parameterization with 17 coefficients.
What the paper found
This paper proves that an unrolled graph-Laplacian denoiser with a order-K Taylor system-matrix expansion followed by m fixed conjugate-gradient steps cannot learn beyond polynomial graph filters: for every coefficient setting, its output is P(Ψ)y, with degree at most K(m−1). In the practical configuration K=10 and m=3, the reachable family is only 17-dimensional inside the 21-dimensional polynomial class P20, making it a measure-zero subset rather than an expanded hypothesis space. At standard initialization, the spectral response is leaky, approaching the nonzero floor 1/(K+1); for measured graph conditioning κ(Ψ)=107, achieving 10−2 relative accuracy requires K≥488, far above the usual order. Experiments on TAMPERE17 grayscale image patches show that with 17 parameters, the unrolled TSE+CG model reaches 26.65±1.67 dB test PSNR, while a direct degree-16 Bernstein graph-filter parameterization reaches 27.52±0.60 dB and optimizes more reliably. The Bernstein form spans the full polynomial class, can represent the target filter exactly, and offers a convex training objective with optional nonexpansiveness guarantees. The central conclusion is that learning solver coefficients changes parameterization and optimization dynamics, not the underlying spectral capacity; changing the graph operator itself is required to escape this polynomial-filter class.
Original abstract
A recent construction of unrolled networks for graph-based image restoration forms a system matrix from a graph-Laplacian denoiser through a truncated Taylor expansion, then inverts it with a fixed number of conjugate-gradient steps, with the coefficients of both stages learned. This paper shows the resulting map is a polynomial in the denoising operator, of degree at most the product of the two truncation orders, for every setting of those coefficients and therefore at every point of training: the learned steps select an element of a Krylov subspace they cannot enlarge. At the orders used in practice the reachable set is moreover a measure-zero subset of the polynomial class of the network's own degree budget, so the composition constrains the hypothesis space rather than enlarging it. At the standard initialization the realized spectral response is obtained in closed form, exceeding the intended response throughout the interior of the spectrum and approaching a nonzero floor. A lower bound on the operator's condition number, internal to the graph construction rather than to image content, then places the order required for a prescribed accuracy well above the order used in practice. The confining class is precisely the spectral graph filters for which a direct, convex parameterization has long been available.
Read the original paperMore in Graph Learning
Browse all 32 papers →CodeGraph: Open-Taxonomy Knowledge Graph for Source Code with Wikidata Grounding
Federico Pennino, Andrea Gurioli, Stefano Zacchiroli, Maurizio Gabbrielli, Paolo Ferragina
CodeGraph turns 167 million source files into a Wikidata-grounded knowledge graph of algorithms, paradigms, patterns, and software domains.
GraphWrit3R: End-to-End 3D Scene Graph Writing
Luka Milivojevic, Nikola Popovic, Sayan Deb Sarkar, Sebastian Koch, Iro Armeni, Luc Van Gool, Danda Pani Paudel
GraphWrit3R turns 3D spatial data into open-vocabulary scene graphs using multimodal encoders and an LLM, without requiring ground-truth object annotations at inference.
Statistical Inference for Causal Discovery under Selection and Latent Variables via Single-Target Interventions
Xiaotian Hou, Kwangmoon Park, Hongzhe Li
This work shows how a small, carefully designed set of single-variable interventions can recover causal structure even when hidden confounders and selection bias complicate the data.