Browse Prior Art Database

Cognitive Video Playback Monitoring across Mobile Devices Disclosure Number: IPCOM000248915D
Publication Date: 2017-Jan-22
Document File: 5 page(s) / 276K

Publishing Venue

The Prior Art Database


Disclosed is a method for monitoring video playing on a mobile device when the user is operating more than one device. The method to gauges the user’s level of distraction in using a second device during video playback, gauges the relevance of the video to the user, and determines whether video playback should be automatically paused so that a user does not miss important video content.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 24% of the total text.


Cognitive Video Playback Monitoring across Mobile Devices

Typically, video playing on mobile devices is watched by a single person - the owner of the mobile device. This presents the opportunity to personalize the video watching experience to the user of the mobile device.

One such area of personalization can address distracted viewing. A user may be watching a video but is then distracted by a notification on another mobile device, causing the user to look away from the video. Eye gaze technology (existing art) can be used to automatically pause the video when a user is not looking at the screen of the mobile device displaying the video, and resume the video when the user's attention returns to the device.

However, tracking if a user is looking at a device is a poor indicator of whether the video should be paused. In today's multi-tasking world, there may be several reasons why the user is looking away from the video, but does not wish to pause it (e.g., distraction is only a few seconds, user is still listening to the audio, current portion of the video is not important to the user, etc.)

Figure 1: User is multi-tasking across two devices while one device is playing a video

Solutions exist for gauging if a user is watching a video on a mobile device, detecting when the user looks away, and automatically pausing a video until the user's gaze returns to the video playing mobile device. Additionally, solutions exist for automatically pausing video through the issuance of gestures. No current solution applies cognitive analysis to identify the user’s current actions when looking away from the video playing device and determine whether the video should be automatically paused due to issues with distraction or relevancy.

The novel contribution is a smarter way to determine when a video on a mobile device should be paused, and when it should continue playing even if the user is not looking directly at it. The core novelty is a system and method to monitor the status of multiple mobile devices operated by a single user to determine the user’s current activities on one device when a video is playing on another device. The system performs cognitive analysis of distracted video watching to determine the distraction type, its relative significance, and historical precedent. This cognitive analysis of video content determines the relevance of a portion of video to a given user based on visual relevance, personal relevance, and narrative relevance. The system automatically pauses of a video it deems that in using a second mobile device the user is sufficiently distracted, and/or video content is sufficiently relevant.


The novel system and method consider the nature of the distraction of another mobile device so that a minor distraction does (e.g., a quick reply to a text message) not pause video, but a more in-depth distraction (e.g., reading an email from the boss) does pause the video. The system considers the content of the video in progress to de...