Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces B-ACT, a boundary-centric active learning framework for temporal action segmentation that focuses annotation efforts on action transition regions. B-ACT uses a two-stage loop to rank videos based on uncertainty and then selects the top-K boundaries within each video using a novel boundary score that considers neighborhood uncertainty, class ambiguity, and temporal predictive dynamics. Experiments on GTEA, 50Salads, and Breakfast datasets demonstrate that B-ACT achieves superior label efficiency compared to existing active learning baselines and prior state-of-the-art methods, especially on datasets where precise boundary placement is critical.
Stop wasting annotation effort on already-easy segments: actively labeling only boundary frames in temporal action segmentation yields surprisingly large gains in label efficiency.
Temporal action segmentation (TAS) demands dense temporal supervision, yet most of the annotation cost in untrimmed videos is spent identifying and refining action transitions, where segmentation errors concentrate and small temporal shifts disproportionately degrade segmental metrics. We introduce B-ACT, a clip-budgeted active learning framework that explicitly allocates supervision to these high-leverage boundary regions. B-ACT operates in a hierarchical two-stage loop: (i) it ranks and queries unlabeled videos using predictive uncertainty, and (ii) within each selected video, it detects candidate transitions from the current model predictions and selects the top-$K$ boundaries via a novel boundary score that fuses neighborhood uncertainty, class ambiguity, and temporal predictive dynamics. Importantly, our annotation protocol requests labels for only the boundary frames while still training on boundary-centered clips to exploit temporal context through the model's receptive field. Extensive experiments on GTEA, 50Salads, and Breakfast demonstrate that boundary-centric supervision delivers strong label efficiency and consistently surpasses representative TAS active learning baselines and prior state of the art under sparse budgets, with the largest gains on datasets where boundary placement dominates edit and overlap-based F1 scores.