Browse Prior Art Database

Method to enhance user interaction with audio-visual multimedia content and devices Disclosure Number: IPCOM000249193D
Publication Date: 2017-Feb-09
Document File: 5 page(s) / 51K

Publishing Venue

The Prior Art Database


It's a method to enhance user interaction with audio-visual multimedia content and devices whereas user reviews the additional information on multimedia is shown to the user on a separate device and user takes action on the separate device without hampering the user experience on the primary display device.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 47% of the total text.


Method to enhance user interaction with audio -visual multimedia content and devices

Current video encoding mechanisms provide capabilities to encode audio-visual objects into the video stream. Using these methods the client applications can be built that allow users to interact with these objects. MPEG-4 for example enables different software and hardware developers to create multimedia objects and embed them to video streams possessing better abilities of adaptability and flexibility to improve the quality of such services and technologies as digital television, animation graphics, the World Wide Web and their extensions. Such objects give users a much more interactive experience when embedded in the video streams.

Also, current video broadcasting solutions lack or have a very limited capability of integrating ecommerce and advertisements into the video streams. Mostly they are made possible by way of generating hyperlinks in a small geometric shape which triggers an event and sends the person who clicked to a certain webpage (youtube for example provides such clickable boxes). For handheld touch screen devices this solution works to a certain extent but household devices such as televisions lack this interaction capability.

The usual solution taken by companies is to allow interaction with video screen and stream by using some device such as remote but the interaction still remains largely limited as only a small set of functionalities such as click or push buttons are possible this way. Described is a system and method of overcoming the above shortcomings of existing solutions. It is proposed to create a system that will decode the video streams that contain audio-visual objects as part of the stream and will route the object specific information that contains the advertisement or the commercial details of the corresponding objects to the handheld device over the wireless communication network. The user of handheld device in turn can review the information on the handheld device and can act on the information in real time or save the information to be acted later on. A filter is proposed that can further modify the object specific information based on criteria such as geography, location (outdoor, inside), sex (male, female), language etc.

Recursive loop to update object – It is proposed to constantly update – whenever required – the object control packets using the user input from the handheld device.

The proposed system contains the video stream, the display device, the decoding engine, the coupling device and a wireless network. The decoding engine could be either inside or outside of the display device. For example in case of television it could be inside whereas in case of projector window, it could be outside the projector as an independent device. Coupling system is used to couple the display device with the handheld device. Wireless network is used for coupling.

In the proposed article, the video stream passes through the decodi...