Search papers, labs, and topics across Lattice.
This paper introduces PCA-guided Activation Scaling (PAS), a novel framework designed to achieve bidirectional and monotonic control over sycophancy in large language models (LLMs) by decomposing activation streams into sycophancy-honesty subspaces. The method allows for precise adjustments to LLM behavior, enabling both reductions and increases in sycophancy with a strong correlation between steering strength and outcomes (Spearman 蟻 = +0.92). PAS outperforms existing techniques, demonstrating an average behavioral shift of 15.4% per direction, significantly improving upon the 8.7% shift achieved by baseline methods.
Achieving a 15.4% shift in LLM sycophancy control with a method that ensures predictable and gradual adjustments could redefine user interactions with AI.
Large language models (LLMs) exhibit sycophancy, a tendency to agree with user beliefs regardless of factual accuracy. This can reinforce misconceptions, but eliminating it entirely risks over-correction against valid opinions. Effective control must therefore both reduce and increase sycophancy with predictable and gradual effect. Yet, existing methods fail to ensure a bidirectional and monotonic relationship between steering strength and behavioral outcome across models and datasets. We introduce PCA-guided Activation Scaling (PAS), an activation steering framework that decomposes residual stream activations into a PCA-identified sycophancy-honesty subspace and an orthogonal residual, then applies distinct scaling exponents to achieve monotonic, bidirectional control. Across three LLMs and three datasets, PAS achieves strong monotonicity (Spearman $\rho$ = +0.92) and an average shift of 15.4% per direction, compared with 8.7% for the baselines. Ablation studies confirm that the decomposition, asymmetric exponents, and layer selection are each essential for maintaining monotonic control. The data and code are available at https://github.com/Bellafc/PCS.
