Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to Implicit Neural Representations (INRs) by modeling neuron activations as damped harmonic oscillators, which adaptively control spectral selectivity during training. This method addresses the trade-off between capturing fine details and avoiding noise memorization without introducing computational overhead or requiring extensive hyperparameter tuning. Experimental results demonstrate that the proposed spectral gating technique achieves state-of-the-art performance, effectively learning low-frequency structures before high-frequency details in a structured manner.
Spectral gating through damped oscillations allows INRs to learn complex signals without the burden of hyperparameter tuning, achieving state-of-the-art results in the process.
Implicit Neural Representations (INRs) have been proven successful in encoding continuous signals through coordinate-based networks, yet facing a spectral dilemma: periodic activations capture fine details but act as all-pass filters that memorise noise, while spatially compact activations regularise effectively but suffer from low-frequency bias. Existing attempts to resolve this trade-off introduce computational overhead or tuning frailty. We propose to model each neuron's activation as the steady-state response of a sinusoidally-forced damped harmonic oscillator, whose amplitude naturally governs the network's spectral selectivity during training. By jointly optimising the oscillator parameters alongside the network weights, our method adapts to the target signal's spectral content without explicit regularisation. Initialised in the stopband, the network exhibits a coarse-to-fine learning curriculum that progressively expands its spectral gate, capturing low-frequency structures first and high-frequency details only when justified by the reconstruction objective. Comprehensive experiments show that our approach consistently achieves state-of-the-art or competitive results against established INRs, while requiring no task-specific tuning of any hyperparameters.
