Search papers, labs, and topics across Lattice.
This paper introduces a video-based framework for automatically reconstructing velocity and stroke rate profiles of canoe sprint team boats from panned and zoomed video recordings, addressing the limitations of GPS-based analysis. The framework employs YOLOv8 for buoy and athlete detection, U-Net based boat tip calibration to generalize boat position estimation, and optical flow for robust tracking across different boat types. Evaluated against GPS data from elite competitions, the method achieves a velocity RRMSE of 0.020 and a stroke rate RRMSE of 0.022, demonstrating high accuracy.
Ditch the GPS: this new video analysis pipeline accurately reconstructs canoe sprint performance metrics from standard video feeds, giving coaches detailed feedback without on-boat sensors.
Pacing strategies, defined by velocity and stroke rate profiles, are essential for peak performance in canoe sprint. While GPS is the gold standard for analysis, its limited availability necessitates automated video-based solutions. This paper presents an extended framework for reconstructing performance metrics from panned and zoomed video recordings across all sprint disciplines (K1-K4, C1-C2) and distances (200m-500m). Our method utilizes YOLOv8 for buoy and athlete detection, leveraging the known buoy grid to estimate homographies. We generalized the estimation of the boat position by means of learning a boat-specific athlete offset using a U-net based boat tip calibration. Further, we implement a robust tracking scheme using optical flow to adapt to multi-athlete boat types. Finally, we introduce methods to extract stroke rate information from either pose estimations or the athlete bounding boxes themselves. Evaluation against GPS data from elite competitions yields a velocity RRMSE of 0.020 +- 0.011 (rho = 0.956) and a stroke rate RRMSE of 0.022 +- 0.024 (rho = 0.932). The methods provide coaches with highly accurate, automated feedback without requiring on-boat sensors or manual annotation.
