Search papers, labs, and topics across Lattice.
VecHeart is introduced as a novel framework for holistic 4-chamber cardiac anatomy modeling, addressing limitations of existing implicit methods in capturing inter-chamber dependencies. The core innovation is a Hybrid Part Transformer that employs part-specific learnable queries and interleaved attention to model complex relationships between cardiac chambers. Experiments demonstrate state-of-the-art performance in reconstruction and generation tasks, including handling partial, sparse, and noisy data, and extending to dynamic 3D+t mesh sequences.
Unlock accurate 4-chamber heart modeling, even from incomplete or noisy data, with a new transformer architecture that understands inter-chamber relationships.
Accurate cardiac anatomy modeling requires the model to be able to handle intricate interrelations among structures. In this paper, we propose VecHeart, a unified framework for holistic reconstruction and generation of four-chamber cardiac structures. To overcome the limitations of current feed-forward implicit methods, specifically their restriction to single-object modeling and their neglect of inter-part correlations, we introduce Hybrid Part Transformer, which leverages part-specific learnable queries and interleaved attention to capture complex inter-chamber dependencies. Furthermore, we propose Anatomical Completion Masking and Modality Alignment strategies, enabling the model to infer complete four-chamber structures from partial, sparse, or noisy observations, even when certain anatomical parts are entirely missing. VecHeart also seamlessly extends to 3D+t dynamic mesh sequence generation, demonstrating exceptional versatility. Experiments show that our method achieves state-of-the-art performance, maintaining high-fidelity reconstruction across diverse challenging scenarios. Code will be released.
