Search papers, labs, and topics across Lattice.
The paper introduces ContextGuard, a structured self-auditing method to improve LLMs' ability to apply complex contextual knowledge. ContextGuard prompts the LLM to explicitly identify and verify its adherence to specific contextual requirements before generating a final answer. Experiments on synthetic and real-world tasks show ContextGuard significantly improves performance, particularly on tasks requiring adherence to format constraints or persistent information.
LLMs can substantially improve their ability to follow complex instructions and constraints by explicitly auditing their own context adherence before answering.
Recent benchmarks reveal that despite strong reasoning capabilities, large language models (LLMs) still struggle to faithfully apply complex contextual knowledge. These failures are often not wholesale reasoning collapses: in context-rich tasks, models may follow the central reasoning path while missing peripheral, persistent, or format-sensitive requirements.
Tsinghua AI