Browse Prior Art Database

A Method and System for Pattern and Gesture Based Typing on Open Palm Virtual Keyboard

IP.com Disclosure Number: IPCOM000242092D
Publication Date: 2015-Jun-18
Document File: 4 page(s) / 94K

Publishing Venue

The IP.com Prior Art Database

Abstract

A method and system is disclosed for pattern and gesture based typing on open palm virtual keyboard.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 32% of the total text.

Page 01 of 4

A Method and System for Pattern and Gesture Based Typing on Open Palm Virtual Keyboard

Disclosed is a method and system for pattern and gesture based typing on open palm virtual keyboard. The method and system allows a user to generate a text input into the user's mobile device by simply using thumb of the user and the palm of the hand as a keyboard proxy. A thumb ring device fitted with pressure sensors is used to track movement of a cursor across a keyboard, and a head mounted display is used to visualize a virtual keyboard layout in front of the user's face. The method and system combines usage of the thumb ring device fitted with pressure sensors with the head mounted display to provide a gesture driven keyboard input mechanism on the virtual keyboard, wherein the user moves the thumb across the open palm to input letters or words into the mobile device. The method and system also enables gesture typing on the palm of the user's hand. Additionally, the gestures allow the keyboard used by the mobile device to be modified, wherein the gestures are monitored by a camera on the head mounted display.

In a scenario, a user wears a ring type device on the user's thumb. The ring type device (e.g., the thumb ring device) is fitted with bending stress sensors installed on different sides and directions of the ring circumference. The user maps a keyboard with the remaining four fingers, and the thumb is used to perform gestures on the four fingers. The user is presented with a visualization of a virtual keyboard projected by a head mounted display. The thumb ring device is installed with a bending stress sensor which tracks the gesture path of the thumb on the four fingers and accordingly moves the cursor on the virtual keyboard, selecting letters (e.g., by selecting individual keys on the virtual keyboard) or words (e.g., by drawing patterns on the virtual keyboard). The user can change the keyboard layout by performing gesture. For example, the keyboard layout is changed by forming a fist type gesture. The gestures are monitored by a camera which is installed on the head mounted display.

The Figure illustrates a user wearing a ring type device on the user's thumb. The user creates a virtual keyboard by opening the palm of the user's hand which acts as an input to a mobile device. The virtual keyboard is mapped with the four closed fingers extending from the user's palm. The user wearing the head mounted display visualizes the virtual keyboard layout in front of the user's face. The user can see a virtual cursor moving across the keys of the virtual keyboard by moving the thumb across the four fingers of the open palm. The ring device installed on the user's thumb track the movement of the thumb to determine the location of the cursor.

1


Page 02 of 4

Figure

The user moves the thumb across the open palm to input letters or words in one or two ways. The user employs gesture typing to form words by forming patterns on the virtual keyboard...