Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
To resolve catastrophic identity drift in video segmentation, POSReasoner introduces a plug-and-play reasoning layer that decouples provisional visual associations from permanent memory updates. The framework maintains persistent states tracking identity, confidence, and absence histories across a sparse state-observation graph, executing a propose-verify cycle to adjudicate whether states should be retained, updated, reactivated, or suppressed. Built on top of frozen backbone segmenters, it achieves consistent performance improvements across competitive long-term VOS and VIS benchmarks, with the most pronounced gains under heavy occlusion and object reappearance.
Video segmenters suffer from persistent identity drift because they blindly write noisy observations to memory; gating state transitions through propose-verify graph reasoning preserves object history through extended occlusions without altering the underlying base model.
Video segmentation models maintain object identities by carrying instance information across frames. Under prolonged occlusion, reappearance, or interactions between similar instances, however, an unreliable update can overwrite a valid history and cause persistent identity drift. We introduce POSReasoner, a trainable, plug-and-play framework that explicitly decides when an observation should change an object's state. Each persistent state records identity, confidence, and absence history. A sparse state-observation graph supports Propose-Verify reasoning: provisional associations are revisited using object history, predicted presence, and competition among identities. The verified decisions determine whether to retain, update, reactivate, or suppress each state, while a learned gate controls the evidence written back to memory. Only verified transitions update the persistent state used in subsequent frames. POSReasoner uses standard video annotations and keeps the base model frozen, enabling integration with diverse VOS and VIS architectures. Experiments across long-term VOS and VIS benchmarks show consistent improvements over strong baselines, with the largest gains under occlusion and object reappearance.