Browse Prior Art Database

Method for declaratively defining gesture recognition that enables early program execution to improve ui responsiveness

IP.com Disclosure Number: IPCOM000247404D
Publication Date: 2016-Sep-02
Document File: 5 page(s) / 109K

Publishing Venue

The IP.com Prior Art Database

Abstract

xxx

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 40% of the total text.

Page 01 of 5

Method for declaratively defining gesture recognition that enables early program execution to improve ui responsiveness

UI bases systems use gestures, think of mouse click, double-click, tab or swipe, to identify operations which need to be performed. The responsiveness of the UI

largely depends on the speed in which the result of that operation can be shown in the UI.

    A gesture is mostly built up of multiple events, think of mouse down/up which result in a click, which can become quite complex. The more complex a gesture

becomes, the longer it takes before the gesture can be identified and the proper operation can be triggered. Now most systems start operation execution on gesture completion which results in a less responsive UI. Modern programming languages emphasize more on offering complete gestures as opposed to the raw events.

    Declarative gesture recognition enables early program execution based on partial gestures. By abstracting this in a declaration, this offers the possibility to query and determine (partial) gestures based on registered event sequences. For example:

    Click, Double-Click and Drag are all build up of similar events. Depending on the approach, (partial) operation execution can be started immediately or specifically, depending on the declaration. This results in earlier execution of (partial) operations and in a more responsive UI.

    A declarative method to define the relationship between gesture, event and operation.

Gesture

Event

Modifier

Operation

Click

Mouse Down, Mouse Up

Left button

DoClick

Mouse Down,

Mouse Up,

Mouse Down,

Mouse Up

Double-Click

Left button

DoDoubleClick

Mouse Down,

Mouse Move

Drag

Left button

DoDrag

Mouse Down,

Mouse Up

ContextMenu

Right button

DoContextMenu

More...

Table 1: Gesture declaration


Page 02 of 5

    Table 1 shows a declaration of recognized gestures, the events it consists of and the operation which needs to be executed for the gesture. Traditionally

execution of the operation would start after the gesture is fully recognized.

The declarative method allows us to easily query event similarity over all

declared gestures. On each subsequent event registration the matching gestures can be re-evaluated and operations can be dismissed when no longer valid.

Event

Modifier

Gestures

PreOperation

Operation

Mouse Down

Left button

Click,

Double-Click,

Drag

DoPreClick,

DoPreDoubleCli ck,

DoPreDrag

Mouse Up

Left button

Click,

Double-Click

Dismiss DoPreDrag

expired

Click

DoClickComplet e

Dismiss DoPreDoubleCli ck

Table 2: Event based operation elimination

    Table 2 shows the elimination of viable operations based on subsequent event registration. Initially all operations of all potential gestures will be executed asynchronously. Subsequent events will dismiss operations which no longer adhere to the registered event sequence. The resulting gesture benefits from the earlier

execution start, resulting in a quicker response of the results in the UI. The

operation needs to be divided in to two part...