Search papers, labs, and topics across Lattice.
This paper introduces LatentGuard, a novel framework that integrates continuous latent reasoning into guard models for large language models (LLMs), significantly enhancing safety moderation while reducing the cost of rationale generation. By employing a staged curriculum to compress textual rationales into compact latent states, LatentGuard enables direct prediction of safety verdicts from these representations, all while maintaining an inspection interface through an auxiliary decoder for audit purposes. Experimental results indicate that LatentGuard-8B not only improves the mean weighted F1 score from 83.95 to 84.91 compared to GuardReasoner-8B but also drastically cuts down the reasoning cost from 268.56 to just 1.60 tokens.
LatentGuard slashes reasoning costs by over 99% while boosting safety prediction accuracy, paving the way for more efficient LLM safeguards.
Reasoning-based guard models improve LLM safeguards, but decoding explicit rationales for every interaction makes them costly to deploy. Although latent-reasoning methods reduce token generation by moving reasoning into continuous states, they remain underexplored for safety moderation and lack an inspection interface for deployment. In this paper, we propose LatentGuard, an efficient and inspectable safeguard framework that brings continuous latent reasoning to guard models. LatentGuard uses a staged curriculum to progressively compress task-aligned textual rationales into compact latent states, enabling safety verdicts to be predicted directly from continuous representations. To preserve inspectability, an isolated auxiliary decoder generates compact audit artifacts on demand, keeping rationale generation off the standard inference path. Experiments show that LatentGuard-8B improves mean weighted F1 from 83.95 to 84.91 over GuardReasoner-8B, while reducing critical-path reasoning cost from 268.56 generated rationale tokens to 1.60 latent reasoning tokens. Its audit decoder achieves an audit utility score of 85.75, demonstrating an efficient and inspectable path toward deployable LLM safeguards.
