Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces StreamDAM, a novel streaming video object segmentation tracker that addresses the limitations of existing models when operating under real-time constraints. By optimizing the memory pipeline to function at frame rate and utilizing a learned presence signal to dynamically manage memory access and output, StreamDAM significantly enhances tracking performance. The results demonstrate that it not only recovers nearly all accuracy from offline models but also surpasses them in challenging scenarios, establishing itself as the leading streaming tracker across multiple benchmarks.
Streaming video object segmentation just got a major upgrade—StreamDAM outperforms offline models in real-time scenarios by intelligently managing memory with a learned presence signal.
Quality-tier video object segmentation (VOS) trackers such as DAM4SAM top accuracy leaderboards, but they are measured offline, one frame at a time with no clock. Under an honest streaming protocol at 30 frames per second, where a frame that misses its budget is served the last mask already computed, the winner collapses: the rich memory that makes it accurate is too slow to keep up, and what it emits is blind to whether the object is even present. We trace both failures to one place, the tracker's memory pipeline, and rebuild it for streaming. \method{} makes the memory machinery itself run at frame rate through in-model optimization rather than a bolted-on fallback, and governs it with a single learned presence signal that decides what enters memory, how far back the tracker reads, when to withhold output, and when to re-detect. A mechanism analysis shows why a fixed policy cannot win: the control that helps when an object truly disappears is the one that hurts when it is merely hard to see, so the choice must be made per frame. Across four benchmarks and five modern baselines, \method{} is the strongest streaming tracker, recovers nearly all of the offline model's accuracy under the clock, and on the hardest content exceeds the offline model it is built from.