Search papers, labs, and topics across Lattice.
PHAST-Net is an innovative attention-guided, physics-informed network designed for the unified estimation of Ideal Time-Frequency Representations (ITFRs), leveraging a new Continuous Log-frequency Adaptive Wavelet Transform (CLAWT) to enhance the resolution and suppress cross-terms in time-frequency analysis. By employing a physics-informed auxiliary reprojection loss, the network ensures transform consistency and energy conservation, which significantly improves optimization stability and accuracy. The model outperforms existing methods in estimating high-resolution representations for complex signals, including speech and music, thereby providing a comprehensive framework for analyzing nonstationary signals.
PHAST-Net achieves unprecedented accuracy in time-frequency analysis by integrating attention mechanisms with physics-informed learning, redefining how we approach signal representation.
We introduce PHAST-Net, an attention-guided, physics-informed network for unified estimation of Ideal Time-Frequency Representations (ITFRs), spanning spectral, tempo-based, metrical, and harmonic representations such as Spectrograms, Tempograms, and Metrograms. PHAST-Net learns an application-general mapping from a constellation of wavelet transforms, the proposed Continuous Log-frequency Adaptive Wavelet Transform (CLAWT), to high-resolution, cross-term-suppressed time-frequency (T-F) representations. The proposed constellation of CLAWTs is selected through Cohen's class kernel analysis to maximise curvature coverage in a logarithmic-frequency T-F plane tailored to harmonic signal structure. PHAST-Net further incorporates a proposed physics-informed auxiliary reprojection loss designed to reconstruct the idealised observed CLAWT constellation from the predicted ITFR and the corresponding Cohen's class kernels during training. This auxiliary objective promotes transform consistency and energy conservation, mitigates pathological target sparsity, and enhances optimisation stability. Attention layers further promote effective cross-term suppression across the input constellation. The log-frequency formulation also enables Harmonic PHAST-Net, which estimates a Harmonic ITFR that isolates fundamental structure, supporting robust fundamental-only representations for speech and music, such as derived fundamental Tempograms and Metrograms. We further introduce Spline-PHAST-Net, which parameterises detected and associated T-F ridges as continuous spline trajectories, enabling arbitrary-grid re-rendering and signal reconstruction. Trained on an effectively unbounded procedurally generated dataset, PHAST-Net demonstrates improved accuracy over established approaches, providing a unified framework for high-resolution, cross-term-robust analysis of speech, music, and broader nonstationary signals.
