Search papers, labs, and topics across Lattice.
This paper formalizes the concept of prefix invariance in hybrid sequence models and introduces a lightweight auditing method to verify it through two forward passes without requiring training or gradients. The authors demonstrate that traditional attention-mask inspection is insufficient for ensuring causality, as it fails to detect leaks that can occur through various mechanisms, while their proposed audit successfully identifies all causality violations in a series of trials. The results reveal critical vulnerabilities in existing models, highlighting the necessity for more rigorous auditing methods in AI systems.
Traditional attention-mask checks miss critical causality violations, while our new audit method pinpointed 100% of failures across multiple models.
Hybrid sequence models must satisfy prefix invariance: representations at position t must not depend on future inputs, yet this is rarely verified. We formalize prefix invariance and give a lightweight audit, two forward passes, no training or gradients, yielding a per-layer score localizing where causality breaks. Attention-mask inspection, the field's default check, is incomplete: causality is a graph-level property, and leaks can occur via scans, aggregations, or normalization despite correct masks. Across 192 injected-fault trials on eight checkpoints, mask inspection detected none, while our audit localized all 192/192 to the exact layer. Static/dynamic analysis of chunked-scan code in transformers found the same defect in Zamba2 and Nemotron-H, an inter-chunk axis error fixed via the reference implementation. The method fits on one page and runs in seconds.
