Search papers, labs, and topics across Lattice.
To overcome the poor cross-dataset generalization of spatial-domain facial landmark detectors, this work formulates FreqFLD, a unified all-in-one framework that explicitly integrates frequency-domain priors into feature representation. The architecture decouples low-frequency global structures from high-frequency local landmark details and uses these signals to adaptively condition a frequency-modulated Mixture-of-Experts (FreqMoE) backbone. This frequency-aware routing, regularized by a dedicated frequency-consistent routing loss, yields robust and balanced landmark localization across diverse benchmarks without dataset-specific tuning.
Decoupling spatial features into high and low frequency priors allows a single sparse MoE model to generalize across heterogeneous facial landmark benchmarks without dataset-specific tuning.
Recent progress in deep learning has significantly advanced facial landmark detection. However, most existing methods process features in a spatial-domain manner under a dataset-specific training paradigm, which overlooks the fact that facial landmark detection is inherently geometry-driven and sensitive to frequency variations, thereby limiting cross-dataset generalization under complex scenarios and hindering the development of a facial landmark detection model. To address this issue, we propose \textbf{FreqFLD}, a \textbf{freq}uency-modulated framework towards All-in-One \textbf{f}acial \textbf{l}andmark \textbf{d}etection. Specifically, FreqFLD introduces a Frequency Modulation Module (FreqMoM) to explicitly induce the frequency prior by decoupling and modulating low- and high-frequency components, which is then injected into subsequent feature modeling to enable balanced modeling of global facial structure and local landmark details. Furthermore, FreqFLD employs a Frequency-Modulated Mixture-of-Experts (FreqMoE), with expert selection adaptively conditioned on frequency-modulated priors, enabling flexible modeling of heterogeneous facial landmark patterns under diverse and challenging scenarios. To regularize frequency-consistent modeling under the All-in-One paradigm, we further introduce a Frequency-Consistent Routing (FreqCR) loss, which constrains the routing and assignment of frequency-aware experts to promote balanced expert utilization across diverse facial scenarios, thereby enabling stable expert specialization and achieving robust facial landmark detection. Extensive experiments demonstrate that the proposed FreqFLD achieves comparable performance on popular datasets. The code is available at: https://github.com/jkj1059657014/FreqFLD.
