Browse Prior Art Database

Translate real time captured 3d env into simple soundscape

IP.com Disclosure Number: IPCOM000246265D
Publication Date: 2016-May-23
Document File: 4 page(s) / 65K

Publishing Venue

The IP.com Prior Art Database

Abstract

This article present an idea to convert real time captured environment data and present the visual information via Audio using 3D positional sound solution.

By employing real time 3D environment capturing technology. it is possible to capture and convert an environment in real time into computational friendly data set. Widely used in the area of Argument Reality to overlap additional information or mask a given object into a computer generated entity (eg. replacing a tabletop into a computer display). The very same mechanism has the potential to provide people with sight disability to enjoy the same captured data via use of Audio. using 3D positional sound system, we can create a abstract layer to generalize and translate a real time 3D captured object into a representation using sound and present the environment in a fashion honest to the geometry of the object in reference to the surrounding environment. Imagine converting the visual data into a rain forest filled with noisy object and animals, walls of trees waving by the wind to represent wall or major obstacle, a drum playing softly representing a garbage bin, people running around replaced with baby elephant zipping around you.

Such mechanism will enable the user to gain a overview of the surrounding environment, a complex environment can be understood quickly, user can gain awareness of space larger their their arm reach and approximate distant and property such as dimension of any object of interest.

This article present one fashion to establish the abstract layer.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 52% of the total text.

Page 01 of 4

Translate real time captured 3d env into simple soundscape

This article present an idea to convert real time captured environment data and present the visual information via Audio using 3D positional sound solution.

By employing real time 3D environment capturing technology. it is possible to capture and convert an environment in real time into computational friendly data set. Widely used in the area of Argument Reality to overlap additional information or mask a given object into a computer generated entity (eg. replacing a tabletop into a computer display). The very same mechanism has the potential to provide people with sight disability to enjoy the same captured data via use of Audio.
using 3D positional sound system, we can create a abstract layer to generalize and translate a real time3D captured object into a representation using sound and present the environment in a fashion honest to the geometry of the object in reference to the surrounding environment.

Imagine converting the visual data into a rain forest filled with noisy object and animals, walls of trees waving by the wind to represent wall or major obstacle, a drum playing softly representing a garbage bin, people running around replaced with baby elephant zipping around you.

Such mechanism will enable the user to gain a overview of the surrounding environment, a complex environment can be understood quickly, user can gain awareness of space larger their their arm reach and approximate distant and property such as dimension of any object of interest.

How does it work:

Using the environment mapping technology provided by current generation device. Objects in a environment can be instantly translate into 3D Model that can be recognized.

We will be creating a conversion engine, that maintain a preference mapping of a spatial object into a given sound generating object. Diagram 1 show a possible 3D env

1



Page 02 of 4

Diagram 2 show how we will attempt to...