Search papers, labs, and topics across Lattice.
This paper introduces a novel framework for estimating batting impact timing using event-based cameras, which offer superior temporal resolution compared to RGB cameras and IMUs. They address the domain gap between event frames and RGB images by generating high-density event frames and employing a mask refinement network with a novel loss function. Experiments on real-world datasets show a 63% reduction in Mean Absolute Error compared to baseline methods, even in challenging conditions like low light and occlusions.
Event cameras can pinpoint batting impact with unprecedented accuracy, even when standard cameras fail due to motion blur and poor lighting.
Estimating the precise timing of batting impact is crucial for understanding the rapid sensorimotor control. However, this task is challenging for RGB cameras due to insufficient temporal resolution and motion blur. Similarly, Inertial Measurement Units (IMUs) are impractical for actual matches due to sensor intrusiveness and their limited temporal precision. To overcome these limitations, we propose a novel framework leveraging event-based cameras, which offer microsecond resolution and high dynamic range, to estimate impact timing based on the weighted centroid distance between the detected ball and bat. To address the domain gap between event frames and RGB images that degrades segmentation accuracy, we generate high-density event frames. We then introduce a mask refinement network that leverages these frames and bidirectional mask information, optimized using a novel loss function. Experiments on real-world datasets demonstrate that our method achieves superior accuracy under challenging conditions, including low-light environments and severe occlusions, outperforming baselines by reducing the Mean Absolute Error by approximately 63%.
