Search papers, labs, and topics across Lattice.
This paper introduces the Factor-Space Topographic Map (FactoMap), a novel approach to disentangled representation learning that accounts for the complex geometries of factor spaces rather than relying on traditional Euclidean coordinates. By integrating factor domains with generator-induced identifications and position-dependent scales, the authors reveal that statistically independent factors can exhibit anisotropic behavior, challenging the assumption of geometric separability. Experiments demonstrate that FactoMap effectively preserves factor continuity and enhances the disentanglement of underlying generative factors, leading to more interpretable representations.
Statistically independent factors can exhibit anisotropic behavior that traditional methods fail to capture, revealing deeper complexities in representation learning.
Many disentanglement methods represent generative factors using Euclidean product coordinates, although the underlying factor spaces may wrap, collapse, or have position-dependent geometry. We introduce factor-space structure, combining factor domains, generator-induced identifications, and position-dependent scales to distinguish topologically equivalent spaces with different factor geometries. We show that statistically independent factors need not be geometrically separable: hue and scale produce effects that grow at different rates, yielding anisotropy that no fixed rescaling removes. We propose the Factor-Space Topographic Map (FactoMap), which learns interpretable prototypes indexed by a factor-space lattice. Topographic learning transfers the lattice's periodicity, collapses, and non-uniform extent to the representation. Experiments show that matching this structure preserves factor continuity and enables disentanglement of the underlying factors.
