Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Testing whether sparse autoencoders (SAEs) recover ground-truth latents or merge co-occurring ones, the authors evaluated thousands of empirical fits across the synthetic MAIS-O43 benchmark over varying sparsity penalties, dictionary sizes, and nesting fractions. Across over 3,500 runs, trained SAEs exhibited neither true feature recovery nor theoretical feature merging, universally converging instead to a "diffuse phase" with near-perfect reconstruction error but poor alignment to true features (cosine similarity 0.5–0.7) and order-of-magnitude denser codes. This divergence reveals that practical gradient descent systematically fails to reach the known analytical global minima of the sparse coding objective, fundamentally separating empirical SAE behavior from theoretical loss landscape predictions.
Standard gradient-trained SAEs can achieve near-perfect reconstruction while remaining entirely misaligned with ground-truth features, reliably trapping models in an uninterpretable "diffuse phase" rather than reaching theoretical sparse minima.
Sparse autoencoders (SAEs) are increasingly used to recover interpretable features from neural-network activations, yet systematic feature co-occurrence can cause distinct features to be absorbed or merged. The MAIS-O43 open problem proposes a controlled experiment to characterize when recovery of a true synthetic dictionary gives way to feature merging as the nesting fraction $γ$, sparsity penalty $λ$, and dictionary size $M$ vary. We implement the specified protocol and evaluate 200 independently initialized fits across ten of the 165 grid cells. We observe zero full-dictionary recoveries and zero merges. Instead, every run converges to a reproducible diffuse phase: reconstruction is nearly perfect, but learned atoms typically remain far from the true features (median best cosine 0.5-0.7 against a 0.95 recovery criterion) and learned codes are an order of magnitude denser than the ground truth. This behavior persists under robustness checks and across the full 165-cell grid using standard minibatch Adam (3,300 additional fits). Since the global optimum of the exact sparse-coding objective is known to merge nested features in the two-feature case, these results suggest that trained SAEs need not reach the corresponding minima, and that the phase diagram of trained models may differ fundamentally from that of objective minimizers.