Search papers, labs, and topics across Lattice.
The paper introduces BiMind, a dual-head reasoning framework for detecting incorrect information by disentangling content-internal reasoning from knowledge-augmented reasoning. BiMind uses an attention geometry adapter to reshape attention logits and a self-retrieval knowledge mechanism to inject relevant in-domain knowledge. Experiments show that BiMind outperforms existing methods and provides insights into the value of external knowledge for this task, quantified by a new metric called Value-of-eXperience (VoX).
Reshaping attention geometries and injecting in-domain knowledge can significantly boost performance in detecting incorrect information, offering a more interpretable approach than monolithic models.
Incorrect information poses significant challenges by disrupting content veracity and integrity, yet most detection approaches struggle to jointly balance textual content verification with external knowledge modification under collapsed attention geometries. To address this issue, we propose a dual-head reasoning framework, BiMind, which disentangles content-internal reasoning from knowledge-augmented reasoning. In BiMind, we introduce three core innovations: (i) an attention geometry adapter that reshapes attention logits via token-conditioned offsets and mitigates attention collapse; (ii) a self-retrieval knowledge mechanism, which constructs an in-domain semantic memory through kNN retrieval and injects retrieved neighbors via feature-wise linear modulation; (iii) the uncertainty-aware fusion strategies, including entropy-gated fusion and a trainable agreement head, stabilized by a symmetric Kullback-Leibler agreement regularizer. To quantify the knowledge contributions, we define a novel metric, Value-of-eXperience (VoX), to measure instance-wise logit gains from knowledge-augmented reasoning. Experiment results on public datasets demonstrate that our BiMind model outperforms advanced detection approaches and provides interpretable diagnostics on when and why knowledge matters.
