Search papers, labs, and topics across Lattice.
2
0
2
Self-supervised projection heads mask severe dimensional collapse in the upstream backbone, a hidden failure mode that can be eliminated by enforcing spectral weight balance directly across encoder layers.
Amortizing distillation across model size and variant can produce a continuum of optimized LLMs with a single distillation run, revolutionizing model deployment efficiency.
