Research & Development

Posted by Kristian Hentschel, Rajiv Ramdhany, Libby Miller on , last updated

We've made an experimental new prototype to help people watch and listen to BBC programmes together even when they are physically apart. It's designed for small groups to watch programmes in a closely synchronised fashion so that you can text, audio or video chat at the same time as watching. We hope people will come together around their favourite programmes, even if they are currently stuck in different locations (because of the current coronavirus lockdown).

Try BBC Together with your friends over at BBC Taster

Running a session is as simple as visiting the BBC Together web page, pasting a link to a BBC iPlayer programme, and getting a unique link to send to your friends. Once everyone is in, you can pause or queue up another programme for everybody at any time.

The system is built on top of the BBC's Standard Media Player and works with almost any BBC audio or video, so doesn't need any additional software to be installed. Our lookup server parses the pasted link to any BBC website and talks to the relevant BBC system to find out how to play the video or audio content on that page. For now, this works with most BBC iPlayer, Sounds, Bitesize, News, and Sport pages - but let us know if you find any links that don't work as expected!

BBC Research & Development has a rich track record in experimenting with object-based, multi-device synchronised experiences which increase immersiveness, interactivity and personalisation. We saw an opportunity to use our expertise in this area to create experiences that could bring people together and engage with BBC programmes. The BBC Together prototype tests our previous research work, but at a larger scale. It allows us to collect valuable audience feedback on these new communal experiences and has allowed us to combine our knowledge, building upon earlier tests and trials. For example:

  • We trialled object-based, multi-screen experiences, showing statistics, infographics or alternative camera angles on additional devices as part of our involvement in the 2-IMMERSE project.

We wanted to use our existing research to make something that would help people during the current pandemic. We've worked across three teams in R&D and with colleagues in iPlayer and Sounds to make this prototype and release it for testing. Successfully integrating our technology with the BBC Standard Media Player means we will also be able to carry out synchronised media trials more widely in future.

How it works

A key component of our prototype is a synchronisation service that enables devices across the internet to very accurately synchronise their playback. The service was initially developed and open-sourced as part of 2-IMMERSE:

 

It works by first getting every participant to synchronise to the server clock ("wall clock" time), and then publishing and subscribing to content timelines derived from this shared understanding of time. The participant devices then report changes in their published timelines via timestamp-containing updates. The server compares timeline updates from all participants which published similar timelines, determines how to reconcile any differences and sends them on to other devices in the session (the timeline subscribers). In lab conditions, this approach can synchronise media to within about 20ms, close enough to show the same frame of video on all devices at the same time. This is well below the threshold in asynchrony that can be perceived by users from across different locations. For this trial, we expect our prototype to perform much better than if users were to try to synchronise by all trying to hit the play button at the same time. In fact, sync'd playback through BBC Together should be close enough to have a video or voice call at the same time and react to the big reveals in a drama, or enjoy the punchlines in comedy programmes together. We're interested in testing how well our prototype scales, whether it makes for a good experience, and whether this very close synchronisation matters.

BBC Together - playing the same programme on three devices at once.

On the participant's device, our plugin for the media player runs an adaptation algorithm that compares the current playhead position to the ideal described by the content timeline. It then generates commands to the player - to play, pause, seek, speed up or slow down - to stay in sync with minimal interruption to the end-user. A particular challenge for the team was designing an acceptable adaptation algorithm to work with DASH playback, where the whole video is not downloaded in advance; every seek command may trigger playback delays as the DASH player buffers the video segments not available in its local cache. We attempted to solve this by minimising the number of big jumps, using small speed adjustments instead where feasible, and by estimating how long the buffering will take. However, this is still not perfect in all situations and may need further research work.

What next?

It is hard to replicate real working conditions, such as load distribution in our experimental environments. We don't know yet how well the various components will scale, and releasing the service in its experimental form is a way we can test this.

We also don't really know if there is an appetite for synchronised audio and video in this form. We think that there might be - there are many "experience together" applications launching, hinting at new, sociable ways to consume content. But we don't know who this might be most useful for, nor which kinds of BBC programmes people want to watch in this way.

It's ready to try out on BBC Taster now, and you can rate it and share it with friends there. We're looking forward to hearing what you think.

Tweet This - Share on Facebook

BBC Taster - Try The Vostok-K Incident

BBC R&D - Vostok-K Incident: Immersive Audio Drama on Personal Devices

BBC R&D - Immersive Spatial Sound Using Personal Audio Devices

Financial Times - BBC pioneers immersive sound using phone speakers

The Telegraph - BBC develops system to turn household objects into surround sound

BBC R&D - Object-Based Media

BBC R&D - Companion Screens

Broadband TV News - BBC work on HbbTV creating personalised content

BBC R&D - Synchronisation to create a Personalised Broadcast

BBC R&D - Seamless Substitution - Mixing IP and Broadcast Video for Personalised TV

This post is part of the Immersive and Interactive Content section

This post is part of the Internet Research and Future Services section

This post is part of the Future Experience Technologies section

Topics