Search papers, labs, and topics across Lattice.
This paper introduces TopoAlign, a novel framework for comparing model representations by analyzing the topology of mapper graphs constructed from those representations. TopoAlign uses joint force-directed optimization to align the global structure of these graphs, identifies local correspondences with Bubble Sets, and enables fine-grained pattern inspection via motif-based queries. Case studies on language and multimodal models demonstrate TopoAlign's ability to provide insights into representation structure and alignment from a topological perspective.
See how your model's representations *really* differ: TopoAlign visualizes the topological structure of representations, revealing insights beyond standard geometric alignment metrics.
Neural networks encode inputs as high-dimensional vectors, known as representations, that capture how models process data by encoding task-relevant structure and semantics. Representation alignment refers to the degree to which different models, layers, or training conditions produce similar representations for the same inputs, with important implications for model interpretation, selection, and robustness analysis. Existing approaches to measure alignment primarily rely on geometric properties, such as neighborhood and cluster similarity, offering limited insight into the global organization of representations. In this work, we present TopoAlign, a topology-aware framework for visually comparing model representations from a structural perspective. Leveraging mapper graphs from topological data analysis, TopoAlign jointly analyzes graphs constructed from representations of shared inputs across different models or layers. The framework supports a top-down comparative workflow: it first performs global structure alignment via joint force-directed optimization to produce coordinated graph layouts; it then identifies local correspondences through automated detection of structurally matching regions, visualized with Bubble Sets; and finally it enables fine-grained pattern inspection through motif-based queries and membrane-inspired visualizations. We demonstrate TopoAlign through case studies on language and multimodal models, complemented by expert feedback. Our results show that TopoAlign provides meaningful insights into representation structure and alignment from a topological perspective.
