Unifying Graph Neural Networks Through a Common Layer Equation
AuthorsSai Karthik Navuluru, Siddhartha Shankar Das, Bo Ni, Hongjie Chen, Yu Wang, Baris Coskunuzer, Nesreen K. Ahmed, Franck Dernoncourt, Mahantesh Halappanavar, Tyler Derr, Ryan A. Rossi, Lakshman Tamil
Resources
This paper gives graph neural networks a common architectural language for understanding, comparing, and designing many different layers.
Key results
The framework organizes over 200 catalogued architectures into seven families.
Component-level results connect support, channel identifiability, propagation limits, and expressivity.
What the paper found
This paper proposes a common graph-neural-network layer equation built from seven components: the update domain, channel set, propagation bank, per-channel message maps, channel-mixing operator, ego or residual map, and update map. Its central factorization separates where information moves, represented by propagation operators, from what moves, represented by message maps. With function-valued component fillings, the equation recovers canonical models including GCN, GraphSAGE, GAT, and GIN, while also covering spectral filters such as ChebNet, relation-specific GNNs, higher-order networks, Graphormer-style global attention, and geometric models such as EGNN. A fixed slot discipline makes comparisons auditable and organizes over 200 architectures into seven nonexclusive families. The framework yields 17 component-level theoretical results, including a proof that local operator support bounds one-layer dependencies, that one-layer global mixing requires a full effective operator row under fixed-operator assumptions, and that raw channel count is not identifiable in the linear additive regime; the invariant quantity is minimum Kronecker separation rank. It also connects propagation choices to oversmoothing, oversquashing, heterophily, and the 1-WL expressivity ceiling. Using the structured design space, the paper generates six formally valid candidate architectures, but emphasizes that choosing the best filling for a dataset remains an empirical inverse problem rather than a solved prescription.
Original abstract
Graph neural networks are commonly described through family-specific equations whose notation obscures shared computations and structural differences. We introduce a common layer equation that represents covered architectures through seven components: an update domain, channel set, propagation bank, per-channel message maps, channel-fusion operator, ego/residual map, and update map. The central factorization separates where information moves, encoded by the propagation bank, from what moves, encoded by the message maps. Function-valued fillings extend the same equation across local message passing, attention, spectral filtering, global communication, relation-specific channels, higher-order domains, and geometric messages. We make this unification explicit and checkable through worked reductions of canonical layers and component assignments spanning seven nonexclusive architectural families. A fixed slot discipline assigns operations by computational role and defines the framework's coverage boundary. The decomposition also yields component-level theoretical insights: under endpoint-local messages and node-local updates, operator support bounds one-layer dependencies, and one-layer global mixing requires a full effective operator row under the stated hypotheses. The resulting framework organizes more than 200 architectures in a common design space, enables component-wise comparison and generation of structurally consistent architectures, and connects propagation choices to oversmoothing, oversquashing, heterophily, and expressivity. It further exposes the empirical inverse problem of mapping measurable graph and task properties to validated component choices.
Read the original paperMore in Graph Learning
Browse all 32 papers →CodeGraph: Open-Taxonomy Knowledge Graph for Source Code with Wikidata Grounding
Federico Pennino, Andrea Gurioli, Stefano Zacchiroli, Maurizio Gabbrielli, Paolo Ferragina
CodeGraph turns 167 million source files into a Wikidata-grounded knowledge graph of algorithms, paradigms, patterns, and software domains.
GraphWrit3R: End-to-End 3D Scene Graph Writing
Luka Milivojevic, Nikola Popovic, Sayan Deb Sarkar, Sebastian Koch, Iro Armeni, Luc Van Gool, Danda Pani Paudel
GraphWrit3R turns 3D spatial data into open-vocabulary scene graphs using multimodal encoders and an LLM, without requiring ground-truth object annotations at inference.
Statistical Inference for Causal Discovery under Selection and Latent Variables via Single-Target Interventions
Xiaotian Hou, Kwangmoon Park, Hongzhe Li
This work shows how a small, carefully designed set of single-variable interventions can recover causal structure even when hidden confounders and selection bias complicate the data.