Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study dissects the internal mechanisms of LLM-based evaluators used in summarization tasks, revealing a two-stage evaluation pipeline that operates distinctly below and above layer 15. By employing an eight-attack perturbation taxonomy and various causal tracing techniques on Themis and Prometheus models, the authors demonstrate that fine-tuning modifies the existing architecture to enhance evaluation accuracy without creating entirely new processes. The findings indicate that the crystallization of ratings occurs sharply in the residual stream at late layers, suggesting that fine-tuning optimizes rather than reconstructs the evaluative framework.
LLM evaluators use a two-stage mechanism where local error comparisons and rating crystallization happen in distinct layers, reshaping our understanding of their decision-making processes.
LLM-based evaluators of natural language generation (NLG) quality are widely deployed as scoring tools and as automated training signals, yet the internal procedure by which they assign a rating remains poorly understood. We investigate this procedure mechanistically through an eight-attack perturbation taxonomy across the Readability and Adequacy dimensions of NLG quality, a generation pipeline that produces paired clean and corrupt summaries with controlled error intensity and explicit token-level modification maps, and a four-experiment battery of causal tracing, logit-lens vocabulary projection, and attention-head knockout applied to Themis (Llama-3-8B) and Prometheus (Mistral-7B). Both evaluators implement a structured, coherent evaluation pipeline operating in two stages: below layer 15, attention performs local error comparison and routes the result to the final input position; above it, the MLP cascade integrates the signal and writes the rating, with the decision crystallizing in the residual stream at a sharp late layer (L = 26 on Themis, L = 25 on Prometheus). Furthermore, a base-model control at the same scale (Llama-3-8B) reproduces the routing architecture and crystallization but not the stage separation, isolating the two mechanisms that fine-tuning specifically installs, suppression of below-L15 MLP contribution at the last position and a two-layer advance of the crystallization depth, indicating that fine-tuning sculpts an existing substrate rather than building the pipeline from scratch. We release the source code and data at https://github.com/himil-v/judge-mech