Search papers, labs, and topics across Lattice.
This paper introduces SonoRank, a novel approach for real-time finger flexion detection using forearm ultrasound sequences, addressing the limitations of existing sEMG-based prosthetics that often require user-specific calibration. By implementing a pairwise ranking of ultrasound sequences based on motion magnitude, SonoRank enhances the classification of finger flexion without the need for fine-tuning for each user. The method demonstrates a significant 28% improvement in F1 score over traditional direct classification methods, paving the way for more accessible and functional powered prosthetics.
Pairwise ranking of ultrasound sequences can revolutionize finger flexion detection, achieving 28% better performance without user-specific calibration.
Powered prosthetic hands are frequently abandoned, largely due to the limited functionality of current devices that rely on surface electromyography (sEMG). Sonomyography (ultrasound) has emerged as a promising alternative, owing to its ability to observe muscle activity in real time and control a greater number of degrees of freedom. Yet, existing ultrasound-based methods require per-user fine-tuning, limiting their commercialization. We propose SonoRank, an important step towards calibration-free finger flexion detection from forearm ultrasound video. SonoRank first learns to rank pairs of ultrasound sequences by their relative motion magnitude for each of the five fingers. The learned representations are then fine-tuned to classify whether each finger is actively flexing, using a rest reference that is captured at the beginning of the operation. Under 12-fold leave-one-subject-out cross-validation on a dataset of twelve subjects with synchronized kinematics, SonoRank achieves a 28% improvement in F1 score over direct classification baselines that skip the ranking stage. These results establish pairwise ranking as an effective pretraining signal for subject-independent control, bringing ultrasound-based prosthetics closer to practical, calibration-free deployment.
