Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study explores the use of top-view video to detect Pen-Up states in handwriting, addressing limitations of traditional tablet-based sensing that misses high-lift movements. By employing a hybrid pipeline that integrates YOLO-based pen-tip tracking with kinematic feature extraction and machine learning classification, the authors achieved an F_2 score of 0.805 in event-level detection. These findings suggest that video analysis can serve as a reliable, low-cost alternative for assessing handwriting dynamics, particularly in developmental disorder evaluations.
Video-based detection of pen movements can achieve an impressive F_2 score of 0.805, offering a game-changing alternative to traditional tablet methods.
Dynamic aspects of handwriting are critical for assessing developmental disorders such as dysgraphia and are typically captured using digitizing tablets. However, tablet-based sensing restricts analysis of Pen-Up behavior to a short proximity range above the writing surface, potentially missing high-lift in-air movements. As a proof of concept, we investigate whether top-view video can provide a complementary source of information for inferring pen-contact states without relying on tablet proximity sensing. We propose an interpretable hybrid pipeline combining pen-tip tracking using a YOLO-based detector with kinematic feature extraction and machine learning classification. A pilot dataset of diverse handwriting videos was manually annotated at the frame level and evaluation used a Leave-One-Video-Out (LOVO) protocol. The method achieved reliable event-level detection of Pen-Up segments, with an F_2 score up to 0.805, consistent with the emphasis on recall in a screening-oriented setting. These results support the feasibility of video-based Pen-Up detection as a low-cost and non-intrusive complement to digitizing tablets, and provide a foundation for future large-scale studies.