Search papers, labs, and topics across Lattice.
This study introduces Decoding-Level Taboo, a diagnostic stress test that evaluates the robustness of large language models (LLMs) by intervening in logit space and forcing models to deviate from their optimized generation paths. The findings reveal that off-path robustness is significantly affected by model size and post-training instruction alignment, with larger and better-aligned models exhibiting improved robustness. This approach not only highlights the discrepancies between benchmark performance and real-world deployment but also offers a new tool for generating diverse datasets and testing model reliability under stress.
Off-path robustness of LLMs can be dramatically influenced by model size and alignment, revealing vulnerabilities often masked by standard evaluations.
Large language model evaluations typically focus on performance under nominal conditions, creating an illusion of capability where models comfortably walk a narrow, highly optimized generation corridor. In real-world deployments, however, complex system prompts, safety guardrails, and structural constraints continuously force models off this nominal path, driving a divergence between benchmark scores and deployment performance. To address this issue, we introduce Decoding-Level Taboo, a zero-prompt diagnostic stress test that intervenes directly in logit space at runtime, forcing models out of their nominal paths. By dynamically masking primary candidate tokens at word boundaries, Taboo forces machine circumlocution. Evaluating Taboo across several open-weight model families reveals that off-path robustness is heavily influenced by both parameter scale and post-training instruction alignment, with robustness generally improving with model size and alignment. Beyond the results presented in this paper, Taboo provides a novel primitive for generating diverse synthetic datasets, stress-testing runtime safety guardrails, and auditing model reliability prior to real-world deployment.
