Browse Prior Art Database

Detection of reflective surfaces within augmented reality headsets

IP.com Disclosure Number: IPCOM000245767D
Publication Date: 2016-Apr-06
Document File: 2 page(s) / 2M

Publishing Venue

The IP.com Prior Art Database

Abstract

Augmented reality is the projection of digital content on to a physical environment, and in the near future, this technology will become more prevalent. Augmented reality can currently be divided in to two classifications, Marker-based and Marker-less. Marker-based requires the user to define the area that they wish to augment by taking a picture for example. In contrast, marker-less augmentation does not require a point of reference for projecting an augmented environment.

In an augmented world users might find themselves in scenarios where they are placed within a video game playing as a the main character in the story, or projecting a real world area. This article proposes a solution to handle reflective surfaces (e.g. mirrors, glass, metal) within these environments.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 74% of the total text.

Page 01 of 2

Detection of reflective surfaces within augmented reality headsets

Figure 1. Microsoft's Hololens projecting a Mars Landscape for Scientific purposes

http://d.ibtimes.co.uk/en/full/1420390/how-microsoft-hololens-will-enable-scientists-w ork-virtually-mars.jpg?w=736&h=414&l=50&t=40&q=80
Figure 2. Microsoft Hololens projecting the video game Minecraft in the user's living room

http://cdn.vrworld.com/wp-content/uploads/2015/02/HoloLens.png

    Reflection detection is currently not handled well if at all in augmented reality. Devices such as the Microsoft Hololens will need to be able to detect and handle reflective surfaces in order to improve immersion and provide a greater experience.

    The invention would detect mirrors using eye tracking using an inward facing camera and the position and orientation of the eyes. A second set of outward facing cameras are constantly capturing images and comparing the image to the image captured from the inward facing cameras. If the system picks up eyes in the external facing cameras, the orientation and position of the eyes in the external image are compared to the internal image and if the images match, the surface must be reflective.

Fig.1 Cameras tracking user's eyes internally


Page 02 of 2

Fig. 2 Cameras tracking users eyes in reflective surface

    If the values collected from the cameras in figure 1 match the values collected to the cameras in figure 2, then the surface must be reflective, and therefore the system will have a point...