BBC Online @20: data visualisation
Technology Engagement Advisor
To mark 20 years of the BBC being online, we wanted to see if there was a way of representing the growth and changing shape of the site over the last 20 years.
Working with data artist Stefanie Posavec, BBC R&D research technologist Rebecca Gregory Clarke, data visualisation designer & developer Peter Cook and BBC Future Media’s Interaction & UX Designer Pete Warren, we came up with the data visualisation you can now view online. The team discuss some of the more technical aspects of the work involved on this project over on the BBC R&D blog.
The data visualisation of BBC Online's history
The animation is powered by a near comprehensive record of BBC server reports since 1994. But after 20 years, a number of different reporting tools and changes in metrics, staff and systems meant that there were some holes in the records. So the greatest challenge for me was to fill these holes - and sourcing the numbers was a hard task. For instance, News and Sport Online stats were recorded separately to those from the rest of the BBC for a long time, so initially there was a large gap with no data between the launch of News Online in 1997 and 2005. I eventually tracked down the relevant numbers from 3 different sources to fill the gap between 2001-2005, but trying to find data on the first three years proved impossible.
There are other things to consider too - for example as the service has developed and matured, on occasions PDA or mobile sites have been within the /mobile directory only to be moved within the directory of the ‘parent’ site later, and there are other editorial quirks such as how some radio news programme pages or World Service sites have been reported as part of News Online. Changes in staffing, editorial priorities and promotion can also influence the amount of content created - and therefore consumed - and the nature of the content and the way a site creates and publishes can have an influence on how it appears in the visualisation. Early pages on the BBC website were text heavy and may have been spread out over many pages, whereas today there is a lot more video on the site, which appears on just one page and results in fewer clicks and requests. Flash and HTML 5 interactive elements mean that sites can be much more dynamic on one page, rather than spreading features out over several.
Clearly there are many elements that affect our visualisation! For all these reasons, it’s best to consider the animation as not a record of popularity of BBC websites over the years or a statistical record (note that we did not include actual figures for this reason), but instead an illustration of how the site has been ordered, structured, and how and where on the site content has been consumed. It’s also great reminder of some of the early sites we’ve loved and lost when used in conjunction with the Internet Archive!
Thanks also to Alison Button, Andrew Nicolaou, Colin Nesbit and Joel Merrick for their help with this project.
Scott Cawley is a Content Producer, BBC Online