Browse Prior Art Database

A method to automatically recognize intended touch coordination based on user's posture.

IP.com Disclosure Number: IPCOM000227734D
Publication Date: 2013-May-14
Document File: 7 page(s) / 148K

Publishing Venue

The IP.com Prior Art Database

Abstract

Mobile devices (tablets, smartphones, etc) provide the convenience to users to use at anytime, anywhere and in any posture. However, if a user uses her/his device in a casual posture, for example lying on bed, it would lose the accurancy on touch screen input. This invention is to learn users' input behavior, and automaticaly adjust user's touch screen input to match her/his intended input coodination. So that, users can enjoy the mobile convenience without limitation.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 44% of the total text.

Page 01 of 7

A method to automatically recognize intended touch coordination based on user 's posture.

    Mobile devices (tablets, smartphones, etc) provide the convenience to users to use at anytime, anywhere and in any posture. Users can use it when sitting, standing, walking or lying. When users are not using the devices in a proper posture, it will create the problem to interact with the device. The most common issue is about accuracy while input on touch screen. When users use it in a proper posture like sitting on chair, they got the best accuracy. They can tape the right position to type the characters they want to input easily. This is because the devices are designed to use in that way and the design consideration includes the view angle, distance from eyes to devices, etc. However, if users use the tablet while lying on bed. The angle, distance will be different, and it will lose the accuracy.

    This invention is to adjust input coordination to what the user intended to touch based on the posturer. It's common on smartphone, tablets to have gyroscope, level meter, camera, etc. By calculating the gyroscope and picture from camera, we can know how the devices is used currently. Then base on that information, we can adjust the received coordination to match what users intended to input.

    For example, when a user tapes one position (x, y) to input "a" when sitting. The device may adjust the received key to "s" by tape the same position (x,y) if the device detected the user is lying. Because that's what user intended to touch but he

just cannot tape the same position while lying due to view angle, distance are not as he is sitting.

Figure 1-1 The device correctly detects the position user touchs

    Figure 1-2 The device fails to detect the position because of the angle user watches it and the angle touches it

1


Page 02 of 7

    On a mobile device we always use a touch screen, which is very different from a mouse of a physical keyboard. With a touch screen, if user does not tap on it with a proper posture and an upright angel, it's very easy to select an incorrect coordination as a result. And because of portability and mobility, users always use their mobile devices anytime and anywhere. So the case to access a mobile device with improper posture or tilted angel is very common. Then the problem to tap on incorrect coordination is also a common issue which is usually encountered by device users.

    We provide a solution to utilize the essential device components "gyroscope" and "camera" for resolving this problem. A gyroscope can detect the tilted angel of a device, and a camera can monitor the user's face and eyes to recognize user's gazing position on the screen. After integrating these kinds of information, we can know how to adjust the input coordination for fitting user's viewing and tapping angel, then the input coordination can be adjusted.

    Here is a scenario: If user is accessing a device while lying on the bed (as Figure 2-2), the gyroscope can...