Immersive Audio/Visual FYP idea pt. 1

Even in 2007, 3D audio such as the virtual barber shop (linked above) has been around. It simulated a convincing replica of real world sounds, especially for it’s time. (1:15 into the video is eerily convincing)

Since then some musicians have delved into simulating the acoustics of audio in the room that it’s recorded in. Eg. Pogo with his binaural mix of his song Upular
Non – 3D : LINK


However, despite having been around for a long time, I don’t feel like it’s been utilized so much nor explored as widely commercially speaking, as visual mediums.

My idea is to create an immersive experience utilizing binaural audio and transport the user to another location.

Binaural audio of the sort I am going for are generally recorded using a Left Right audio configuration and using molded ears to replicate the way sound is shaped before entering the ear canal.

Image result for binaural audio

I find the ability to disassociate from your current location to another in such a manner very calming.

Ironically, by not taking in their current environment and transporting them elsewhere, it can create a mental space to be in the moment.

I find this to be a very meditative experience and does provide respite from the mental stresses of life by dropping everything in that moment to take in the totality of the scene.

I intend to do this through a mix of both audio and visual means. With binaural audio as the focus, and the visuals as a complimentary choice.

I find the visuals to be immensely helpful as while some might find the audio experience with eyes closed to be stronger, with the visuals I intend to use, which are specific places as opposed to a situation like in the case of the virtual barber shop, the sounds are very much tied to the visuals that occur.

For example, if we hear the snap of a twig or the rustle of some bushes, being able to open your eyes and see the bush rustle or a branch bend will help actualize the place in the minds eye as opposed to being swung back to the users current location the moment they open their eyes.

We’ve seen 3D come and go, and now Virtual Reality and Augmented Reality being taking center stage.

Virtual reality has it’s entry level limit for both headset hardware and computing hardware to support the system while AR seems to be a good blend of accessibility with phones and integration with the existing environment, which i think makes it a strong contender as a medium of the future. Perhaps because the requirements of binaural audio requiring headphones to be effective limits the experience to the individual AND on top of that, the quality of their headphones. Whereas cinemas can make use of a singular screen and sound system for simultaneous usage.

This makes me wonder about subsequent exploration for perhaps mass binaural audio experiences, but for another time.

Leave a Reply