Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces the "Matching Principle," a unifying geometric theory that frames various robustness techniques (e.g., CORAL, adversarial training, IRM) as estimators of the covariance of label-preserving deployment nuisance, and regularizes the encoder Jacobian accordingly. The theory provides closed-form optimality proofs in a linear-Gaussian model, including conditions for cube-root water-filling and range coverage necessity for quadratic Jacobian penalties. Empirical validation across diverse tasks, including large language models, demonstrates the predicted ordering of regularization strategies based on their alignment with the nuisance covariance, using a novel "Trajectory Deviation Index" to probe embedding sensitivity.
Forget independent robustness tricks – a single "Matching Principle" explains how everything from adversarial training to Jacobian penalties boils down to estimating and regularizing for label-preserving deployment nuisance.
Robustness, domain adaptation, photometric and occlusion invariance, compositional generalisation, temporal robustness, alignment safety, and classical anisotropic regularisation are usually treated as separate problems with separate method families. This paper argues that much of their shared structure is one statistical problem: estimate the covariance of label-preserving deployment nuisance, then regularise the encoder Jacobian along a matrix whose range covers that covariance (the matching principle). CORAL, adversarial training, IRM, augmentation, metric learning, Jacobian penalties, and alignment-style constraints are different estimators of that object, not independent robustness tricks. In the linear-Gaussian model we prove closed-form optimality (Theorem A), including cube-root water-filling within the matched range; necessity of range coverage for quadratic Jacobian penalties (Theorem G); the same range dichotomy at deep global minima; and two falsification controls (Lemma C; Corollaries E), with seven conditional consistency lemmas (D1-D7) for estimation under standard identifiability assumptions. We introduce the Trajectory Deviation Index (TDI), a label-free probe of embedding sensitivity when task accuracy or Jacobian Frobenius norm is insufficient. Thirteen pre-registered blocks from classical ML through Qwen2.5-7B test the predicted matched, then isotropic, then wrong-W ordering on geometry and deployment drift; twelve pass, and the sole exception (Office-31) is an eigengap failure named before the run. At 7B scale, matched style-PMH improves selective honesty and preserves Style TDI where standard DPO degrades it. The contribution is naming the deployment nuisance covariance, stating what the regulariser must do, and supplying a closed-form falsifiable theory once that object is identified, not universality on every leaderboard.