Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
ReflexTrack introduces a feedback-driven approach to referring video object segmentation (RVOS) that operates without task-specific training, enhancing both spatial and temporal accuracy. By employing Mask-guided Spatial Refinement and Video-level Mask Reflection, the method iteratively refines segmentations based on real-time feedback from the video data. The approach achieves significant performance improvements, evidenced by a $\mathcal{Q}$ score of $69.7$ on Ref-VPS and a $\mathcal{J}\&\mathcal{F}$ score of $67.2$ on ReasonVOS, highlighting the effectiveness of prediction-level feedback in RVOS tasks.
Feedback-driven refinement in RVOS leads to a remarkable boost in segmentation accuracy without any training, challenging the need for task-specific models.
Referring video object segmentation (RVOS) requires segmenting a target specified by natural language throughout a video. Recent agentic approaches combine multimodal large language models with promptable segmentation models to perform RVOS without task-specific training. However, most pipelines rely on one-shot spatial grounding followed by mask propagation, leaving both the initial prompts and temporal predictions largely unverified. We introduce ReflexTrack, a training-free, feedback-driven agent that closes this loop at both spatial and temporal levels. Mask-guided Spatial Refinement evaluates the mask induced by the current keyframe prompt and iteratively updates the bounding box together with positive and negative points, yielding a more reliable initialization. Video-level Mask Reflection assesses the complete mask sequence, localizes unreliable intervals, selects complementary repair keyframes, and generates candidate predictions through mask-guided re-propagation. Only candidates that provide a verified improvement are used to update the affected intervals, preserving reliable predictions elsewhere. All components remain frozen during inference. ReflexTrack achieves an overall $\mathcal{Q}$ score of $69.7$ on Ref-VPS and a $\mathcal{J}\&\mathcal{F}$ score of $67.2$ on ReasonVOS. These results demonstrate that prediction-level feedback substantially improves the reliability of training-free RVOS.