Browse Prior Art Database

Media Content Display of Photos or Video based on Contextual Analysis and Directional Gesture of Location

IP.com Disclosure Number: IPCOM000247829D
Publication Date: 2016-Oct-06
Document File: 5 page(s) / 115K

Publishing Venue

The IP.com Prior Art Database

Abstract

Disclosed are a system and method for a display device with novel software that can analyze the relative directional input from a hand gesture and context of the content, and accordingly retrieve the appropriate media contents from search results, formatted in appropriate direction for display.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 33% of the total text.

Page 01 of 5

Media Content Display of Photos or Video based on Contextual Analysis and Directional Gesture of Location

While navigating any photograph (photo) album, 360-degree video, or when searching images, a user provides various search criteria and then performs an action such as a mouse click or touch gesture on a mobile device to move to the next photo in the sequence. The user's next content viewing requirement is very dynamic. For example, if a photo is displayed on a television screen, the user might want to show one relative direction of the currently viewed photo, and then view the next photo in a different direction.

The user might indicate to the system, "Just show direction with hand", and accordingly want to view the related media contents as follows:


 Left side of the current photo


 Right side of the current photo


 In front of the current photo


 Above the current photo

The content that is displayed next might be contextual and directional.

As per the current methods, when using a touch gesture, the user can view the next or previous photo based on a defined sorting criteria (e.g., date, time, location, etc.).

In addition, while viewing the photo album with a group of people, the user and other viewers might talk about various events or situations within the context of direction.

The novel contribution is a method and system by which the photograph album display device can analyze the relative directional input from a hand gesture and relevant context of the content discussion, and accordingly retrieve the appropriate media contents as search results, formatted in an appropriate direction for display. The system includes a combination of mobile device capabilities, social media input, and streaming analytics. The method can be applied to photos, standard video, and 360 video.

The novel software relies on a prerequisite of a digital camera device with the ability to capture photos or video with an associated Global Positioning System (GPS) location and compass direction stored as metadata for the photo or video. The contents of the media and metadata can be stored within social media or directly on the display device.

Components:


 Camera capture device (e.g., digital camera, smart phone with camera, etc.); compass and GPS sensor installed to record direction and location with photo metadata.


 Display device (e.g., smart TV, tablet, smart phone, computer, etc.)


 Camera integrated with the display device to capture the user's eye focus

1


Page 02 of 5


 Camera integrated with the display device to capture the user's hand gestures for pointing direction


 Smart watch


 GPS sensor and compass installed to determine direction from which user is pointing with a hand gesture


 Cognitive components can be implemented on remote cognitive system accessible via the Internet or on local display device


 Image analytics for facial recognition to identify user


 Component to identify location of current photo...