Search papers, labs, and topics across Lattice.
This paper introduces a budget-friendly virtual keyboard system that utilizes a standard camera and a printed keyboard layout to enhance user mobility in computer interactions. By integrating modern computer vision techniques with traditional image processing, the system efficiently detects keyboard regions and identifies keystrokes through fingernail color analysis. Experimental results indicate that this approach not only simplifies setup compared to existing solutions but also garners positive user feedback regarding its practicality and engagement.
A simple camera and a printed layout can replace traditional keyboards, making mobile computing more accessible and user-friendly.
Interacting with computers typically relies on traditional input devices such as keyboards, mice, and monitors, which can be cumbersome for users seeking greater mobility. Virtual keyboards have been explored to address these limitations, but they often involve complex setups or expensive equipment. This paper proposes a novel virtual keyboard system that leverages only a standard camera and a paper with a printed keyboard layout. Unlike previous methods requiring complex calibration or special lighting conditions, our approach can work on standard environment using modern computer vision technologies. Combining modern segmentation and detection models with traditional image processing algorithms, we efficiently identify the keyboard region. Touch detection is performed using an algorithm analyzing the color of the user's fingernail. Experiments demonstrated a promising results our proposed solution of keyboard and keystroke detection for practical applications. Participants attended our user study also found the proposed system interesting.
