Search papers, labs, and topics across Lattice.
To combat "Response Drift"鈥攚here models breach system constraints despite benign-looking inputs鈥攖his work introduces ELCD, a post-generation, pre-delivery latent conflict detector for open-weight LLMs. The approach maps full generated sequences into a composite latent space combining final-token and mean-pooled hidden representations, training a detector via pairwise margin ranking to cleanly separate compliant from compromised trajectories. Evaluated across models from 1.5B to 14B parameters, ELCD improves PR-AUC on Llama-2-7B by roughly 30 percentage points and slashes the false positive rate at 95% recall (FPR95) down to 2.67% on Mistral-7B.
Static input guardrails remain blind to silent system prompt overrides, but inspecting post-generation latent trajectories catches constraint-violating responses before delivery while slashing false positive rates to under 3%.
Large Language Models (LLMs) are increasingly deployed with hierarchical instructions, yet they remain vulnerable to conflicts in which user directives override system-level constraints. Existing defense mechanisms predominantly focus on static input inspection and therefore fail to detect Response Drift, a phenomenon in which the model's final response violates system-level constraints despite seemingly compliant inputs. To bridge this gap, we introduce ELCD, a response-level latent conflict detector for post-generation, pre-delivery verification. Given the full generated output, ELCD constructs a composite hidden-state representation by concatenating the final-token embedding with the mean-pooled response embedding. It then optimizes a pairwise margin ranking objective to separate compliant and drifting responses in latent space. Extensive experiments across five mainstream LLMs ranging from 1.5B to 14B parameters demonstrate that ELCD significantly outperforms competitive baselines. Notably, it improves the PR-AUC on Llama-2-7B by approximately 30 percentage points and reduces the False Positive Rate at 95% TPR (FPR95) on Mistral-7B to 2.67%. These results suggest that ELCD provides a promising approach for latent instruction-conflict detection in open-weight or self-hosted LLM deployments.
