Track new results across pure and applied mathematics.
Search papers, labs, and topics across Lattice.
PRISM-$\Delta$ is introduced as a method for prompt highlighting in LLMs, addressing the challenge of extracting steering directions that differentiate between relevant and irrelevant contexts. It decomposes the difference between positive and negative cross-covariance matrices to maximize discriminative energy while eliminating shared directions, and assigns continuous importance weights to attention heads. Experiments across benchmarks and models demonstrate that PRISM-$\Delta$ matches or exceeds existing methods in most configurations, with improved fluency and scalability to long-context retrieval.
Prompt highlighting in LLMs gets a serious upgrade: PRISM-$\Delta$ steers models to focus on relevant text spans with better accuracy and fluency, even in long contexts.
Prompt highlighting steers a large language model to prioritize user-specified text spans during generation. A key challenge is extracting steering directions that capture the difference between relevant and irrelevant contexts, rather than shared structural patterns common to both. We propose PRISM-$\Delta$ (Projection-based Relevance-Informed Steering Method), which decomposes the difference between positive and negative cross-covariance matrices to maximize discriminative energy while eliminating shared directions. Each attention head receives a continuous softplus importance weight, letting weak-but-useful heads contribute at reduced strength. The framework extends naturally to Value representations, capturing content-channel signal that Key-only methods leave unused. Across four benchmarks and five models, PRISM-$\Delta$ matches or exceeds the best existing method on 19 of 20 configurations, with relative gains up to +10.6%, while halving the fluency cost of steering. PRISM-$\Delta$ also scales to long-context retrieval, outperforming the best existing method by up to +4.8% relative gain. PRISM-$\Delta$ is compatible with FlashAttention and adds negligible memory overhead.