Search papers, labs, and topics across Lattice.
This paper introduces a unified framework for the parametric analysis and reproduction of spatial audio, capable of handling both Ambisonic signals and raw microphone array inputs. By estimating time-frequency-dependent spatial metadata that captures the characteristics of primary sources and ambient sound, the method constructs optimal mixing matrices for transcoding audio scenes to various playback formats. Listening tests reveal significant perceptual advantages of this framework, especially when applied to lower-order and geometrically constrained microphone arrays, compared to existing state-of-the-art methods.
Perceptual tests show that a new transcoding framework significantly enhances spatial audio reproduction, especially for constrained microphone setups.
This article introduces a unified framework for the parametric analysis and reproduction of spatial sound scenes captured either as Ambisonic signals or as raw microphone array signals. The proposed method estimates time-frequency-dependent spatial metadata that characterises a variable number of primary source components and an ambience component with its own angular power distribution, whose parameters fit the observed spatial covariances of the captured signals. This metadata is used to construct spatial covariances of the target playback formats, which are then used to derive optimal mixing matrices for transcoding the scene for playback over the target reproduction system. The method additionally handles independent rotations of both capture and playback setups. Real-time implementations of the method and other existing state-of-the-art parametric renderers are compared in a listening test using simulated scenes from Ambisonic, spherical, and head-worn arrays. The results highlight perceptual benefits of the proposed framework across a diverse range of content and receiver configurations, particularly for lower-order and geometrically constrained microphone arrays.
