Search papers, labs, and topics across Lattice.
The paper introduces Latent Attention Masked Autoencoder (LAMAE), a novel masked autoencoder architecture designed to handle the multi-view nature of echocardiography data by incorporating a latent attention module for information exchange across frames and views. LAMAE is pretrained on the large-scale MIMIC-IV-ECHO dataset and achieves strong performance in predicting ICD-10 codes from echocardiography videos, demonstrating its ability to learn holistic cardiac representations from partial observations. The learned representations also exhibit effective transfer learning capabilities from adult to pediatric cohorts, highlighting the benefits of incorporating structural priors like multi-view attention.
Multi-view attention in masked autoencoders unlocks surprisingly robust and transferable representations for echocardiography, even across significant anatomical differences between adults and children.
Echocardiography is a widely used modality for cardiac assessment due to its non-invasive and cost-effective nature, but the sparse and heterogeneous spatiotemporal views of the heart pose distinct challenges. Existing masked autoencoder (MAE) approaches typically process images or short clips independently, failing to capture the inherent multi-view structure required for coherent cardiac representation. We introduce Latent Attention Masked Autoencoder (LAMAE), a foundation model architecture tailored to the multi-view nature of medical imaging. LAMAE augments the standard MAE with a latent attention module that enables information exchange across frames and views directly in latent space. This allows the model to aggregate variable-length sequences and distinct views, reconstructing a holistic representation of cardiac function from partial observations. We pretrain LAMAE on MIMIC-IV-ECHO, a large-scale, uncurated dataset reflecting real-world clinical variability. To the best of our knowledge, we present the first results for predicting ICD-10 codes from MIMIC-IV-ECHO videos. Furthermore, we empirically demonstrate that representations learned from adult data transfer effectively to pediatric cohorts despite substantial anatomical differences. These results provide evidence that incorporating structural priors, such as multi-view attention, yields significantly more robust and transferable representations.
