Browse Prior Art Database

Television Inventions for improved User Interface II Disclosure Number: IPCOM000243505D
Publication Date: 2015-Sep-25

Publishing Venue

The Prior Art Database

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 13% of the total text.

Page 01 of 12

Copyright 2015 TP Vision Holding B.V.

Television Inventions for improved User Interface II

1. UI for device-less control


- Device-less interaction requires a specifically designed UI, due to the fact that accidental motions can (unintended) select items. Having a well-designed UI can circumvent this problem by making it less likely that accidental motions will control the UI.

- Current solutions require rather large motions making control of the UI cumbersome.

- Using device-less interaction in combination with a standard UI is difficult since the requirements for precision is high, and some actions such as text input are difficult to realise with hand movements alone.

- The standard select action, in most user interfaces provided by a button on a remote control or mouse, is very difficult to achieve using a single camera that analyses hand motions.

- On the other hand, cursor position control can be realised by observing hand motions with a camera.

- Pre-defined gestures for control are problematic because they have to be known to the user.


We propose to provide item selection (e.g. volume) and level selection (e.g. volume-level) as a single, continuous spatial path. This makes device-less control intuitive and efficient. The UI is separated into at least two axes. A point on the first axis defines the starting point of the spatial path, and a point on the second axis defines the end-point of the spatial path. The starting point corresponds to the item selection, whereas the end-point corresponds to the level selection. The idea is illustrated in figure 1. Essential to the idea is that the path is drawn real-time while progressing thereby allowing the user to adjust the hand motion to arrive at the intended volume level.

Figure 1: Illustration of spatial path for simultaneous item and level selection. Example is given for volume control. The path is visualized to allow for easy selection.

Page 02 of 12

Copyright 2015 TP Vision Holding B.V.

Possible extensions

- Instead of one, or two axis, three or more axis may be used to facilitate multiple levels in a hierarchical (tree-based) menu structure. E.g. a third axis may be placed horizontally at the top of the screen, and a fourth axis may be placed at the left vertical border of the screen.

- This menu is only shown when a person is detected and raises his hand to indicate that control is needed. An unlock signal is needed.

- The path coordinates may be filtered using signal processing methods to facilitate more robust selection. A deviation from likely paths, or an incomplete path will not trigger an action.

- A gravity vector may be used to pull back the path to its origin when the detected hand motion has only a small upwards pointing motion component. This means that if a hand is kept stationary, the line will 'un-draw' until it arrives at the staring item.

Page 03 of 12

Copyright 2015 TP Vision Holding B.V.

2. Interactive Images playback and rendering wit...