Search papers, labs, and topics across Lattice.
This paper introduces Recast, a novel framework for forecasting trajectory-level safety risks in large language models (LLMs) during multi-turn interactions. By analyzing both short-term dialogue progression and long-term historical context, Recast effectively models the evolution of risks across interaction trajectories, enabling preemptive identification of potential safety failures. The framework achieves an impressive 88.3% accuracy in predicting future safety violations with a lead time of 2.41 turns, significantly enhancing proactive safety measures in LLMs.
Recast forecasts 88.3% of future safety failures in LLM interactions, allowing for proactive risk management before violations occur.
As large language models (LLMs) evolve from standalone assistants into autonomous agents, ensuring their safety requires shifting beyond pointwise risk assessment to understand how risks emerge and unfold over long-horizon trajectories. In multi-turn interactions, malicious intent can be decomposed across seemingly harmless turns and gradually reconstructed through interaction trajectories, eventually resulting in safety failures. Existing safeguards remain largely reactive, detecting manifested violations while lacking the ability to predict latent risk evolution and enable preemptive prevention. To address this limitation, we propose Recast, a safety risk forecasting framework that advances LLM safeguarding beyond turn-level violation detection to trajectory-level risk prediction. Recast first retrieves risk-relevant evidence from both short-term dialogue progression and long-term historical context via a dual-scale trajectory view. It then models compositional risk evolution by capturing the current risk configuration and its temporal dynamics. Finally, a causal temporal encoder learns latent risk evolution patterns and predicts the distribution of future risk emergence turns. Extensive experiments across 7 risk categories show that Recast predicts 88.3% of future safety failures with an average lead time of 2.41 turns, while maintaining a false alarm rate of 12.3%, showcasing the effectiveness of trajectory-level forecasting in identifying emerging risks before safety violations occur.
