Search papers, labs, and topics across Lattice.
Independent Researcher
1
0
2
Even without denoising objectives, transformers spontaneously self-repair corrupted inputs via a two-phase residual stream mechanism—and whether that repair succeeds is predictable from the very first transformer layer.
