Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
This paper systematically benchmarks eighteen neural network architectures on ten abstract sequential tasks, revealing BiGRU, TCN, Conv1D, and GRUReLU as consistently top-performing and compact models. These top architectures were then applied to estimate dynamic arm gesture speed from skeletal keypoints, achieving low mean absolute errors for peak count, period time, and mean spike spacing interpretations. The findings demonstrate the efficacy of neural networks for speed-aware gesture recognition, enabling more responsive robotic control.
Four neural network architectures consistently outperform others on diverse temporal pattern recognition tasks, offering a practical foundation for speed-aware robotic gesture control.
Deploying intelligent robotic systems that interact with humans through gestures requires neural networks capable of recognizing diverse temporal patterns. We present a systematic benchmark of ten abstract sequential tasks--five permutation-invariant (set) and five order-dependent (sequence) problems--evaluated across eighteen neural network architectures spanning recurrent, convolutional, attention-based, and set-function families. Beyond the core architecture-task grid, we explore numerous preprocessing and target-variable transformations, yielding more than 250 distinct experimental configurations. All variants are trained and tested under strictly identical conditions (fixed random seeds, shared hyperparameters, shared data splits) to ensure fair and reproducible comparison. Ranking across all ten tasks reveals four consistently top-performing architectures--BiGRU, TCN, Conv1D, and GRUReLU--all compact enough for real-time deployment (under 2,000 parameters in the benchmark setting). Based on this ranking, we apply three architecturally diverse top models (BiGRU, TCN, and GRUReLU) to a practical robotics problem: estimating the execution speed of dynamic arm gestures from skeletal keypoint sequences. Three speed interpretations (peak count, period time, and mean spike spacing) are evaluated on a custom dataset of eight traffic-related gesture classes comprising 256,710 frames recorded via OpenPose. The best configuration achieves a mean absolute error of 0.198 on the peak-count interpretation, corresponding to roughly 5% relative error, while the period-time interpretation reaches approximately 4% relative error, and the mean spike spacing interpretation approximately 8% relative error. These results demonstrate that neural networks can reliably estimate gesture speed from skeletal data, opening a path toward speed-aware gesture-controlled robotic systems.