NTH

Recurrent Sinusoidal INRs for Efficient High-Fidelity Representation

AuthorsHyunmin Cho, Jaejun Yoo, Kyong Hwan Jin

August 1, 2026 2 min read
Watch on YouTube
The one-line take

A recurrent sinusoidal neural representation learns sharper images and 3D signals with fewer parameters and optimization steps.

Key results

63.378
PSNR after recurrent unrolling

PSNR in dB at 5 recurrent steps, compared with 39.724 dB for one feed-forward pass.

593.7K
Fixed parameter budget

Parameter count maintained while increasing recurrent unrolling from 1 to 5 steps.

58.16
Set5 early reconstruction

PSNR in dB after 100 iterations with 609K parameters.

42.84
Kodak24 early wall-clock fidelity

PSNR in dB reached in 6.52 seconds.

64.19
Recurrence ablation on Kodak24

PSNR in dB for recurrent refinement before adding binarized supervision, versus 42.15 dB for the feed-forward baseline.

What the paper found

Researchers Hyunmin Cho, Jaejun Yoo, and Kyong Hwan Jin at Korea University and UNIST propose Harmonic-Siren, a recurrent implicit neural representation that reuses one bias-free sinusoidal block across multiple unrolled steps instead of adding independently parameterized layers. Their harmonic line-spectrum analysis, derived through the Jacobi–Anger expansion, shows that sinusoidal transformations generate integer combinations of learned coordinate frequencies, enabling iterative enrichment of high-frequency content. At optimization step 500, increasing recurrent unrolling from one feed-forward pass to 5 steps raises PSNR from 39.724 dB to 63.378 dB with the parameter count fixed at 593.7K. The model also combines bipolar Gray-coded supervision with cosine alignment, allowing exact quantized reconstruction: on Set5, it reaches 58.16 dB and 0.9997 SSIM after only 100 iterations using 609K parameters. On Kodak24, it reaches 42.84 dB in 6.52 seconds and 59.12 dB in 22.45 seconds, substantially faster than feed-forward baselines. Ablations show that recurrence, rather than binarized supervision alone, supplies the main fidelity gain, improving Kodak24 PSNR from 42.15 dB to 64.19 dB before exact coding reduces bit error to zero. The decoder also transfers to super-resolution, NeRF on LLFF, and signed-distance-function reconstruction, although gains weaken under severe parameter constraints.

Original abstract

We study sinusoidal recurrence as an iterative mechanism for harmonic spectral enrichment in implicit neural representations (INRs). Our analysis reveals that sinusoidal activations induce a harmonic line spectrum, providing a spectral account of how recurrent unrolling enriches the effective spectral support. We realize this principle with a shared sinusoidal block that iteratively refines the latent representation. We empirically validate the resulting spectral behavior against feed-forward INRs, non-sinusoidal recurrent variants, and equilibrium-style sinusoidal models. Complementing this analysis, we evaluate the proposed architecture across image and 3D representation tasks. On RGB image benchmarks, our method achieves higher fidelity than feed-forward baselines with fewer parameters and fewer optimization steps, and it further transfers favorably to super-resolution, NeRF, and SDF tasks.

Read the original paper

More in Neural Networks

Browse all 22 papers →
02Neural Network

Retrieving Individual Stems from Music Mixtures with Slot Embeddings

David Braun, Junyi Fan, Pranay Manocha, Donald S. Williamson, Adam Finkelstein

Stembed lets music producers search for individual instrument sounds hidden inside a full song by representing the mixture as multiple searchable stem-like embeddings.

Read analysis
03Neural Network

The Linear Representation Hypothesis Needs a Group Action

Louie Hong Yao, Yuhao Li, Shengchao Liu

This paper argues that claims about linear representations only become meaningful once we specify which transformations leave a representation essentially unchanged.

Read analysis