Recurrent Sinusoidal INRs for Efficient High-Fidelity Representation
AuthorsHyunmin Cho, Jaejun Yoo, Kyong Hwan Jin
Resources
A recurrent sinusoidal neural representation learns sharper images and 3D signals with fewer parameters and optimization steps.
Key results
PSNR in dB at 5 recurrent steps, compared with 39.724 dB for one feed-forward pass.
Parameter count maintained while increasing recurrent unrolling from 1 to 5 steps.
PSNR in dB after 100 iterations with 609K parameters.
PSNR in dB reached in 6.52 seconds.
PSNR in dB for recurrent refinement before adding binarized supervision, versus 42.15 dB for the feed-forward baseline.
What the paper found
Researchers Hyunmin Cho, Jaejun Yoo, and Kyong Hwan Jin at Korea University and UNIST propose Harmonic-Siren, a recurrent implicit neural representation that reuses one bias-free sinusoidal block across multiple unrolled steps instead of adding independently parameterized layers. Their harmonic line-spectrum analysis, derived through the Jacobi–Anger expansion, shows that sinusoidal transformations generate integer combinations of learned coordinate frequencies, enabling iterative enrichment of high-frequency content. At optimization step 500, increasing recurrent unrolling from one feed-forward pass to 5 steps raises PSNR from 39.724 dB to 63.378 dB with the parameter count fixed at 593.7K. The model also combines bipolar Gray-coded supervision with cosine alignment, allowing exact quantized reconstruction: on Set5, it reaches 58.16 dB and 0.9997 SSIM after only 100 iterations using 609K parameters. On Kodak24, it reaches 42.84 dB in 6.52 seconds and 59.12 dB in 22.45 seconds, substantially faster than feed-forward baselines. Ablations show that recurrence, rather than binarized supervision alone, supplies the main fidelity gain, improving Kodak24 PSNR from 42.15 dB to 64.19 dB before exact coding reduces bit error to zero. The decoder also transfers to super-resolution, NeRF on LLFF, and signed-distance-function reconstruction, although gains weaken under severe parameter constraints.
Original abstract
We study sinusoidal recurrence as an iterative mechanism for harmonic spectral enrichment in implicit neural representations (INRs). Our analysis reveals that sinusoidal activations induce a harmonic line spectrum, providing a spectral account of how recurrent unrolling enriches the effective spectral support. We realize this principle with a shared sinusoidal block that iteratively refines the latent representation. We empirically validate the resulting spectral behavior against feed-forward INRs, non-sinusoidal recurrent variants, and equilibrium-style sinusoidal models. Complementing this analysis, we evaluate the proposed architecture across image and 3D representation tasks. On RGB image benchmarks, our method achieves higher fidelity than feed-forward baselines with fewer parameters and fewer optimization steps, and it further transfers favorably to super-resolution, NeRF, and SDF tasks.
Read the original paperMore in Neural Networks
Browse all 22 papers →End-to-End Hard-Label Cryptanalytic Model Extraction Using Efficient Sign Recovery
Akira Ito, Takayuki Miura, Yosuke Todo
A new query-efficient technique makes it possible to steal the parameters of small black-box neural networks using only their predicted labels.
Retrieving Individual Stems from Music Mixtures with Slot Embeddings
David Braun, Junyi Fan, Pranay Manocha, Donald S. Williamson, Adam Finkelstein
Stembed lets music producers search for individual instrument sounds hidden inside a full song by representing the mixture as multiple searchable stem-like embeddings.
The Linear Representation Hypothesis Needs a Group Action
Louie Hong Yao, Yuhao Li, Shengchao Liu
This paper argues that claims about linear representations only become meaningful once we specify which transformations leave a representation essentially unchanged.