Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors build the Imprint Reader, a system trained via Semantic Mount-and-Read Tuning (SMaRT) to decode frozen weight updates into natural-language descriptions of acquired knowledge and behaviors. While descriptive readout achieves an initial 16% Pass@100 on behavioral updates, the Reader's coordinate-aligned gradients can be inverted via MetaEdit to steer model weights toward target behaviors without task-specific training data. Applying this gradient-based editing improves harmful-prompt refusal from 57.9% to 64.1% via targeted pruning and boosts Berkeley Function-Calling performance from 41.69% to 44.60%.
Weight updates leave readable textual imprints: decoding parameter shifts into natural language enables direct, gradient-based behavioral steering without any downstream fine-tuning data.
As language models take a growing role in AI development, a natural aspiration is for them to reflect on their own learning process, as humans do, and use that reflection to improve themselves. At the same time, these models have an advantage that human learners lack, since training leaves parameter-level traces that can, in principle, be inspected directly. However, current models cannot decode these traces into an explicit account of what they have learned. To this end, we introduce the Imprint Reader, a model trained with Semantic Mount-and-Read Tuning (SaRT) to describe frozen weight updates. SMaRT mounts each update onto the Reader and uses an anchor-free meta-query to elicit a natural-language description, while no-change and random-perturbation controls discourage unsupported claims. On held-out updates, the joint Reader reaches judge-based Pass@100 of 2% for knowledge and 16% for behavior. These results demonstrate the feasibility of natural-language readout while pointing to reliability across updates as the next step. Beyond free-form generation, the Reader provides a differentiable proxy for the gap between a specified target behavior and a candidate weight update. Its coordinate-aligned gradients support intervention through MetaEdit. At a 0.5% pruning rate, Reader-guided selection raises measured harmful-prompt refusal from 57.9% to 64.1% under a safety-maintenance target. Using behavior descriptions without target-task training data, MetaEdit increases the frequency of backtracking and sub-goal expressions in mathematical reasoning traces and raises BFCL Overall from 41.69% to 44.60%.