System and Method for Computational Media Aesthetics: An Algorithmic Study of the Use of Sound and Images in Digital Video and TV/Film for Augmented Content Annotation and Production, and Mass Communication
Original Publication Date: 2002-Nov-15
Included in the Prior Art Database: 2002-Nov-15
Disclosed is a system and method of analyzing multimedia using a novel approach called the Computational Media Aesthetics. Media aesthetics is a process of examination of media elements such as lighting, picture composition, and sound by themselves and a study of their role in manipulating our perceptual reactions, in communicating messages aesthetically, and in synthesizing effective productions. We define computational media aesthetics as the algorithmic study of a number of image and aural elements in media and the computational analysis of the principles that have emerged underlying their use and manipulation, individually or jointly, in the creative art of clarifying, intensifying, and interpreting some event for the audience. This field enables distilling techniques and criteria to create efficient, effective, and predictable messages the first time around in media communications, and to provide a handle on evaluating relative communication effectiveness of media elements during TV/film production. Whilst the area of affective computing aims to understand and enable computers to respond to emotions of users, computational media aesthetics aims to understand how directors use visual and aural elements to enhance the emotional experience for the audience.