Browse Prior Art Database

Visual selection of IOT devices using AR glasses and eye tracking

IP.com Disclosure Number: IPCOM000247200D
Publication Date: 2016-Aug-16
Document File: 1 page(s) / 36K

Publishing Venue

The IP.com Prior Art Database

Abstract

Disclosed is a system for utilizing augmented reality with a method of visual identification (for example QR codes) as a means to select internet of things devices to control; without the need for the user to give any indication of the object other than looking at it. This will allow an extremely efficient method of controlling devices without the need for the user to know how a device is identified. For example, a user could look up at a light and say "half brightness" and the light would switch to half brightness.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 54% of the total text.

Page 01 of 1

Visual selection of IOT devices using AR glasses and eye tracking

There has been much work in Augmented Reality (AR) glasses which includes cameras on the inside which track a user's eye. This can be used to determine what object the user is looking at and provide contextual information based on the user's sight. There is also work involved with controlling IOT devices using augmented reality such as controlling robots - MIT's reality editor. There is currently no work related to selecting devices on a network using eye tracking using a visual ID on the object itself.

However, when there are multiple IOT devices in a room the main way to

select which devices to control via voice is through the use of an identifier, e.g. if there are multiple voice controlled lights, a command could be "Light 2 turn on". When there is a danger of commands being received by the wrong devices and there is a confusion about which device the user wants to control, a user needs to somehow give a command that also includes a device identifier.

    There is not currently a method of a user selecting the device to control by simply looking at it. This idea considers using AR glasses with eye tracking as a method of identifying and selecting physical IOT devices that are marked with a visual ID and connected to the same local network. The IOT device itself can then be controlled by voice or any other control mechanism.

    For example: if there are multiple voice controlled lights, the user can look at a single light with AR glasses on and give the command "Turn off". The light that the user is looking at will then turn off and leave the rest unaffected.

    The AR glasses and all IOT devices are connected and registered to a single network. Each IOT device will have available commands that can be sent t...