Browse Prior Art Database

Method of Using Holographic Objects for Virtual Guidance of Procedures and Troubleshooting

IP.com Disclosure Number: IPCOM000247478D
Publication Date: 2016-Sep-09
Document File: 4 page(s) / 101K

Publishing Venue

The IP.com Prior Art Database

Abstract

Disclosed is a holographic-based instructional system that provides an ecosystem that identifies tasks and any project sequence of activities in order to guide a user through the task.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 44% of the total text.

Page 01 of 4

Method of Using Holographic Objects for Virtual Guidance of Procedures and Troubleshooting

The use and manipulation of object components in a holographic display is known art. The next generation computing systems will use holographic objects for various user interactions. It uses multiple holographic components in an instruction set, so that the user may fully understand the instructions prior to applying the instructions to a real product.

A method and apparatus are needed by which a user can learn through holographic images prior to fulfilling the same instructions on the real set of components. The holographic ecosystem needs to identify tasks, project objects with a sequence of activities, and guide the user to perform various procedures and troubleshooting tasks. The user can then fully understand and practice the tasks in a safe, holographic environment prior to executing the instructions in a physical, labor-intensive environment. In addition, such a system needs to self-teach as users running instances of any holographic ecosystem can manually provide feedback, or as perceived by the system itself.

The novel solution is a holographic-based instructional system. The novel system provides an ecosystem that identifies tasks and any project sequence of activities in order to guide a user through the task. It uses multiple holographic components in an instruction set, so that the user may fully understand the instructions prior to applying the instructions to a real product. In this way, the user can fully understand the instructions prior to executing the task with heavier or more labor intensive situations. The system holographically highlights the correct parts and the sequential assembly of said parts in a series of steps.

The system incorporates self-learning, as it provides feedback (e.g., typical user errors) to a centralized server. The system collects usage/error information through micro cameras and image analysis combined with system smarts. Alternatively, users can manually submit feedback. The system applies the usage information to adjust or improve the instructions or the product itself, in order to alleviate that problem area in the future. The manufacturer could learn of new situations for which the product needs to work and store that for other users.

This applies to both large-scale projects (e.g., assembling an automobile) and small-scale projects (e.g., hanging a ceiling fan in a home).

Invention Components:


 Mobile device (e.g., smart phone, wearable smart device, tablet, laptop, etc.)


- Three-dimensional (3D) holographic projection capability


- Network connectivity to a holographic ecosystem and knowledge base to retrieve solutions and to provide feedback information

- Image analysis capabilities


In some embodiments, to provide the ecosystem with more

1


Page 02 of 4

information (e.g., types of parts)

To observe/interpret user actions and provide feedback (e.g., user has a better way of performing a t...