BBC R&D

Posted by Tom Parnell, Jack Reynolds on , last updated

Most virtual reality audio is a combination of created atmospheres, in-scene sounds, dialogue, and computer-generated music. But the BBC VR Hub’s Nothing to be Written, like The Turning Forest before it, takes sound as the basis of its conception.

VRTOV and BBC Research & Development created the magical visual world of The Turning Forest out of the S3A project’s specially-written spatial audio drama. And in Nothing to be Written, 59 Productions have crafted a moving montage of First World War imagery, to accompany new music by composer Anna Meredith. Commissioned by the BBC Proms, Edinburgh International Festival, and 14-18 Now, Meredith’s piece, Five Telegrams, is written for orchestra, choir, and several offstage instrumental ensembles. The immersive VR experience takes the second movement, Field Postcards, as its basis, setting to music the chillingly generic messages available to troops to send home from the battlefield; the choir opens the piece with the words “I am quite well”.

Download Nothing to be Written from the Oculus Store

Or experience it at one of the BBC orchestras’ Armistice Day events:

St David’s Hall, Cardiff

Barbican Centre, London

Or at libraries around the country this weekend:

Sailsbury, Chorley, Oldham, Taunton, Ripon, Plympton, and Oxford.

The cutting-edge spatial soundtrack for Nothing to be Written was recorded live at the 2018 Proms performances. For each Proms season, over one hundred microphones are rigged at the Royal Albert Hall in London to create BBC Radio 3’s stereo mixes and BBC Television’s surround sound mixes. For Five Telegrams, further mixes were created for live PA reproduction at the Proms Curtain Raiser event, and for an immersive installation in Edinburgh. But the aesthetics of a VR soundtrack are very different from a broadcast mix or an ambient installation, so Field Postcards needed careful remixing to transform the live recording, made in a traditional classical concert setting, into a musical experience that fully surrounds the listener.

Anna Meredith: Five Telegrams - Sender & Receiver

BBC Research & Development engineers used the Reaper digital audio workstation and audio plug-ins from Blue Ripple Sound to pan the microphones in three dimensions, and to produce a ‘third-order ambisonics’ mix - a high quality spatial audio format suited to VR production. This encapsulates the entire spherical ‘soundfield’ in 16 channels of audio, which was imported into the Unity game engine using Blue Ripple Sound’s Rapture3D audio SDK. The project served as a useful opportunity to evaluate a growing number of ambisonics panning, rendering and reverberation plug-ins for use in future VR productions.

A screenshot of the tools used to mix Nothing to be Written in binaural sound.

The immersive soundscape changes and responds instantly to your movements in VR. This tracked audio experience means that as you look around the VR environment, the audio will render in real-time in order for sound sources to appear static within the scene, despite constant re-orientation by the viewer. Although the music is not anchored to any visual element in Nothing to be Written, the dynamic audio experience really heightens the musical emotion and the visual narrative of the work.

Similar technology from BBC Research & Development was used this summer to help the Radio 3 sound engineers create binaural sound mixes of some other BBC Proms concerts. This is an immersive audio experience, without the tracked VR experience, but which you can listen to on normal headphones, and sounds much like being at the hall in person.

Sound is such an enriching and inspirational element of virtual reality, we’re already on the look-out for our next audio-led VR production.

Tweet This - Share on Facebook

BBC Proms - Virtual Reality

BBC VR Hub

BBC R&D - An Introduction to BBC Reality Labs

BBC Writer's Room - Writing Drama for Binaural Sound

BBC R&D - Virtual Reality Sound in The Turning Forest

BBC Connected Studio - Watch 20 minute talks from our experts on Virtual Reality and 360 Video from #BBCVR day

BBC R&D - 8 Tips for Producing VR Projects

BBC R&D - Factual Storytelling Tips for 360 Video

BBC R&D - 360 Video & Virtual Reality

BBC R&D - Why is BBC R&D interested in Virtual Reality?

More on Virtual Reality and 360 Video from the BBC Academy including:

Virtual reality production: Where do I start?

The making of 'Damming the Nile' in 360

Factual storytelling in virtual reality

How do I make 360 videos?

Progress in VR: when the content is more interesting than the technology

This post is part of the Immersive and Interactive Content section

Topics