Search papers, labs, and topics across Lattice.
The paper introduces Adaptive Manifold Prototypes (AMP), a framework that uses Riemannian optimization on the Stiefel manifold to represent class prototypes as orthonormal bases, preventing rank one prototype collapse. AMP learns class-specific effective rank and uses spatial regularizers to reduce rotational ambiguity and encourage localized part evidence. Experiments on fine-grained benchmarks show AMP achieves state-of-the-art classification accuracy and improves causal faithfulness compared to prior interpretable models.
By representing prototypes as orthonormal bases on the Stiefel manifold, this work makes prototype collapse infeasible by construction, leading to more interpretable and accurate image recognition.
Prototype networks provide an intrinsic case based explanation mechanism, but their interpretability is often undermined by prototype collapse, where multiple prototypes degenerate to highly redundant evidence. We attribute this failure mode to the terminal dynamics of Neural Collapse, where cross entropy optimization suppresses intra class variance and drives class conditional features toward a low dimensional limit. To mitigate this, we propose Adaptive Manifold Prototypes (AMP), a framework that leverages Riemannian optimization on the Stiefel manifold to represent class prototypes as orthonormal bases and make rank one prototype collapse infeasible by construction. AMP further learns class specific effective rank via a proximal gradient update on a nonnegative capacity vector, and introduces spatial regularizers that reduce rotational ambiguity and encourage localized, non overlapping part evidence. Extensive experiments on fine-grained benchmarks demonstrate that AMP achieves state-of-the-art classification accuracy while significantly improving causal faithfulness over prior interpretable models.
