Browse Prior Art Database

Method and System for Eye Direction Based Video Layer Change

IP.com Disclosure Number: IPCOM000246658D
Publication Date: 2016-Jun-24
Document File: 3 page(s) / 62K

Publishing Venue

The IP.com Prior Art Database

Abstract

Disclosed are techniques to allow a user watching any video to select the subject of focus simply by looking at the object or area of the screen. When the system determines that the user is looking at some object, the video automatically updates to bring that object or section of the screen into clear view.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 41% of the total text.

Page 01 of 3

Method and System for Eye Direction Based Video Layer Change

While capturing any video, a videographer can control the focus area by adjusting lens focal length, accordingly some portion of video frame becomes blur and some portion are clear.

Figure 1: Current field of focus; the front foliage is in clear focus and the rear foliage is blurred

Figure 1 is rudimentary; it is not possible for the viewer to clearly view the blurred portion. This current system restricts the viewer from clearly viewing the whole video captured by the videographer. There is no flexibility for the viewer to view the video content per dynamic needs. Multi-lens cameras are available. None offers the user the ability to watch a video and automatically bring into focus the subject of interest.

A method or system is needed to implement some degree of flexibility to improve the viewer's dynamic viewing experience. The desire is to provide the capability for the correct object to automatically come into clarity simply based on detecting the user's area of visual focus.

The novel system enables a video viewer/user to automatically bring into focus an area of the video simply by staring at the blurred portion of the frame. This disclosure proposes a method and system by which a video camera with multiple lenses is used to capture various focal centers for any video frame in a series of video frames. The system uses these focal points to adjust the shown video based the user's detected area of visual focus. At all times, at least one portion of the video content in each video frame is perfectly clear. The user can automatically choose the subject of focus simply by looking at that object or area of the screen.

While playing any video, the default focus areas are clearest, as chosen by the videographer. However, as a user is watching the screen, something in the background or out of the focal area might pique the user's interest. While the user is looking at that, cameras on the display device detect the object of the viewer's focus. Based on that information, the system swaps frames to bring into focus the area of interest (i.e. what the user is looking at).

Furthermore, the system can self-learn over time to understand what the user likes to

1


Page 02 of 3

keep in focus (in case there is a choice) and automatically selects that layer for the person.

Implementation of the system requires a multi-lens camera, a video display, and image processing capabilities. Multi-lens camerasexist on the market and are necessary for creating and collecting each aspect of a given picture or frame in focus, if desired by the end user. Cameras always have a single or primary camera. That camera is constantly focused on what the producers have decided is the most important feature of any scene. In addition, a second, third, or more cameras can be simultaneously filming the same scene with the same surrounding parameters, but with different objects, actors, or sections of the scree...