Search papers, labs, and topics across Lattice.
This paper investigates the impact of high-temperature sampling on the refusal behavior of large language models (LLMs), which is critical for maintaining safety in response to harmful prompts. The authors propose a sequential decoding method that effectively preserves the model's refusal responses while allowing for increased output diversity, achieving 91-99% retention of greedy decoding refusal behavior across multiple datasets. Their findings highlight a viable approach to balancing the benefits of high-temperature sampling with the necessity of robust safety mechanisms in LLMs.
High-temperature sampling can enhance diversity in LLM outputs without sacrificing refusal behavior, achieving up to 99% retention of safety responses.
High-temperature sampling is one of the primary mechanisms for increasing diversity in LLMs. Recent advances in truncation-based sampling techniques have helped mitigate drawbacks of high-temperature sampling such as neural text degeneration, thereby enabling greater diversity in LLM outputs without sacrificing coherence. However, increasing the entropy of the token probability distribution via high temperatures has also been shown to weaken model guardrails by reducing the model's refusal response in the presence of harmful prompts. Despite the potential benefits of high-temperature sampling and the importance of maintaining model safety, there is a lack of existing solutions for maintaining the refusal behavior of LLMs under a higher entropy regime. To address this gap, we systematically study how temperature influences refusal behavior in LLMs and propose an efficient sequential decoding approach which preserves a model's greedy decoding refusal response at high temperatures while incurring minimal additional latency. Through extensive experiments, we show that our approach preserves 91-99% of the greedy decoding refusal behavior across three benchmark datasets without compromising the model's high-temperature response for safe prompts. Our work demonstrates how refusal behavior can be maintained in an efficient manner for applications which require high-temperature sampling.
