Search papers, labs, and topics across Lattice.
This paper introduces FrameONE, a novel end-to-end framework for detecting end-systole (ES) and end-diastole (ED) frames in echocardiographic videos across multiple views. By employing a Hierarchical Motion Modeling strategy, FrameONE effectively reduces appearance bias through intra-view multi-task learning and enhances generalization by separating view-agnostic dynamics from view-specific patterns. Extensive evaluations on a dataset of 25,872 videos reveal that FrameONE achieves state-of-the-art accuracy in keyframe detection while demonstrating robust cross-view performance.
FrameONE revolutionizes echocardiographic keyframe detection by achieving state-of-the-art accuracy through a unified multi-view approach that overcomes traditional limitations.
Accurate detection of end-systole (ES) and end-diastole (ED) frames is fundamental to echocardiographic assessment. Existing methods are typically developed in a view-specific manner, depend on auxiliary annotations or intensive visual modeling, which limits their generalizability. In multi-view modeling, keyframe detection is driven by shared cardiac motion, yet large appearance differences and motion patterns make unified modeling challenging. To address these issues, we propose FrameONE, a unified end-to-end framework for multi-view echocardiographic keyframe detection. FrameONE introduces a Hierarchical Motion Modeling strategy: an intra-view multi-task learning reduces appearance bias and promotes motion-focused representations within each view; an inter-view general motion learning module further separates view-agnostic dynamics from view-specific patterns, enabling shared yet flexible motion representation learning across views. Extensive experiments on 25,872 videos spanning four standard views demonstrate that FrameONE achieves state-of-the-art keyframe detection accuracy with strong cross-view generalization. Code is available at https://github.com/szuboy/FrameONE.