Immersive Listening

3D Sound for Immersive Experiences

For my week 5 assignment, I had to create my own sounds using VCV Rack - an open source modular synth simulator.

I had a blast creating more than an hour of blip, bloops and other original sounds.

Snippets of the track were edited and mastered in Reaper to be turned into spatial sound objects for a future VR experience created with the Unreal Engine.

using vcv sounds in unreal - 3d audio spatialization.

Selected some of my favorite and more relevant sounds created in VCV Rack and added them to Unreal engine as 3D spatial sound objects.

The sound files were edited for “looping” and placed in areas around this environment I’ve built using basic template objects.

The goal was to create distinct transitions between areas with the help of careful placement of 3D sound.

For some of the effects I created sound cues - programmable sound objects. This allows for Unreal to change sound parameters in many ways. In this case a combined two different sound files and added a random filter and several different EQ modulators. This allowed for the creation of different sounds inside the “temple” area every time the user entered it. It almost works, since for now it only creates a few simple variations of the original sounds.

The next goal is to add some “head locked sounds”: ambient sound that covers the entire area, creating a more cohesive experience as well as amplifying the sense of being in an open, living world.

HighresScreenshot00001.png

Immersive Listening - Assignment 01: Subway Guy

For the first assignment I had to create an immersive audio environment combining my own recordings with library assets. With everything in place, the whole thing should evoke a narrative of sorts.

Luckily, I’ve been working on 3D virtual illustration based on my documentation of a singer playing on the New York subway. I took a picture of it and also recorded him singing using my ZOOM H1n recorder.

Quill VR Illustration - August 2018

Quill VR Illustration - August 2018

Creating the Immersive Environment

The final sound environment is composed by 4 different audio tracks: The singer; the subway; steps and the birds.

The singer and the Subway were recorded by me in separate occasions. The steps and the birds were download from freesound.org. As I joined them inside Reaper (audio editing software), I tweeked levels and the timing in order to create a sequence of events. The goal is to tell a little surreal story, where the listener is transported from a walk down the subway station to a different realm through the music of a lonely, soulful singer.