Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper tackles the challenge of reconstructing dense Head-Related Transfer Functions (HRTFs) from sparse measurements by framing it as a neural operator learning problem. The proposed SPARO model projects sparse HRTF measurements onto learned spherical latent modes, processes these modes with Transformer blocks, and decodes them to generate a continuous HRTF field. SPARO achieves state-of-the-art accuracy in log-spectral distortion and interaural level difference, significantly outperforming existing methods in reconstruction speed.
A neural operator reconstructs continuous HRTF fields from sparse measurements with 18% lower LSD and 43% lower ILD error than leading baselines, achieving 373x speedup over neural fields.
Head-related transfer function (HRTF) spatial upsampling from sparse measurements is a fundamental challenge in personalized binaural audio. We formulate HRTF upsampling as an operator learning problem and introduce SPARO, a neural operator that maps sparse measurements at a set of spatial directions to the HRTF field, a continuous representation that can be queried at arbitrary positions. SPARO projects the measurements onto a learned set of spherical latent modes, processes the latent modes with Transformer blocks, and decodes the resulting representations at query directions. On SONICOM, using the LAP24 measurement configuration, SPARO attains the best log-spectral distortion (LSD) and interaural level difference (ILD) error at every sparsity level from 3 to 100 measurements (18% lower LSD and 43% lower ILD error than the strongest baseline at 100 measurements) while remaining competitive in interaural time difference (ITD) error. It reconstructs a dense HRTF 15 to 373 times faster than the leading neural-field method RANF. We further validate the approach on HUTUBS, demonstrating its effectiveness across HRTF datasets.