Andy Finney: Was modern internet technology influenced by Domesday?
Article written by Andy Finney
Producer on the original BBC Domesday Project
The discussion pages on Wikipedia are sometimes more interesting than the articles.
The BBC Domesday Project has its page and, until recently, it included a note about the kinds of online applications we know and love, such as mapping and Google Street View, that had their equivalents in the Domesday Project.
Any mention of the BBC being a red rag to certain Wikibulls, this note was expunged by an anonymous editor who was concerned about "weasel words and no citations to any reference that this project in any way 'led the way' or 'inspired' any present mapping software or service."
This got me thinking. What key 'new' bits of technology were there in, and were we first, and is it possible that the likes of Google were influenced by this? My colleagues will probably come up with a few more (and that's what comments are for) but here's my set.
Some Domesday features just grew organically. Once we knew that the UK mapping had to be based on 4 by 3 blocks - the aspect ratio of 1980s TV screens - and there were existing paper maps that allowed us to show 4 by 3 km or 40 by 30 km in that space it seemed logical to allow horizontal and vertical jumps across those maps and to be able to 'zoom' from one scale to another.
It was a simple concept once an algorithm had been developed (my memory says by Dr Martin Porter) and worked by jumping between frames on the disc. Unlike current systems such as Google Maps and MultiMap it was not possible to dynamically render the maps on demand so paper maps for the whole of the UK had to be cut up, joined together where necessary and put beneath a video rostrum camera at the BBC Open University Production Centre in Milton Keynes.
The National Disc allowed users to select sets of data (such as population) and display these overlaid on maps on demand. This also was highly unusual in the mid 1980s, when computers managing statistics still usually occupied a whole air conditioned room and required white-coated acolytes.
Every photograph and every piece of text was allocated keywords based on a pre-determined vocabulary. This concept was well-established long before the 1980s (and today keywords sit in the invisible headers of every well-structured web page).
Where Domesday pushed the envelope a little was with the way the queries could be entered. We didn't feel that members of the public could (and should be asked to) use boolean logic with this and that but not the other. Dr Martin Porter came to the rescue.
Martin had produced a search system called Muscat early in the decade and had also developed what is now known as the Porter Stemming Algorithm. Stemming is the linguistic method by which your computer system knows that the words 'search', 'searching' and 'searched' actually refer to the same concept.
For Domesday this allowed the text searching to work out what the key words were when a user entered a sentence in the search box. In the original system you can watch as the system extracts the key words from your sentence and counts through the hits it finds on one or more of them.
Stemming in free text searching is used by today's web search engines. You can try it for yourself by putting in different versions of a word and seeing what the search engine returns.
The virtual machine
Whereas my original interactive video experiments had been written in BBC Basic, the Domesday Project required more sophisticated programming, notably to overcome the memory limitations of the BBC Micro and its 8 bit environment.
Fortunately Acorn had published a BBC Micro chip for a language called BCPL, which is often referred to as a forerunner of C, arguably the most influential computer language.
BCPL, which was developed In Cambridge by Dr Martin Richards, was a two-stage system whereby the program would be compiled into what was called CINTCODE (Compiled INTermediate CODE) and a second piece of software, called a virtual machine (VM) ran that CINTCODE on the computer.
In theory you could 'easily' change the VM and run the same code on another computer. Today the virtual machine concept is probably best known in Java. It should be possible to take Domesday's BCPL code and run it on a VM under Windows or Linux or whatever on a modern computer.
This process was used back in the 1980s for the Research Machines version of the Domesday System and to demonstrate Domesday running on an Acorn Archimedes computer.
There are four key reasons why the BBC couldn't just update the BCPL VM to run Domesday now: no source code (the BBC were not given it), translating disc commands such as frame numbers (for images) into file names, working around a few bits of the code that relied on the word size (number of bits) in the original system ... and the cost of doing the first three. Besides, even if this were achieved it would produce a stand-alone Domesday system, rather than the web-based one that the Reloaded team have made.
The Domesday team were aware of an interactive video project made around 1978-80 at the American University MIT which enabled a user to take a virtual trip around Aspen Colorado. It was called the Aspen Moviemap.
The MIT team used a specially-rigged car (not unlike the Google Street View car) to take thousands of still images of the streets and could then navigate around them from a touch-screen and an array of videodisc players.
We wondered whether we could use a simplified version of this idea in the UK and after some experiments decided we could use this to show the main types of housing in the UK and a few typical examples of 'the outside world'.
The Domesday walk model looks clunky compared to Street View and QuickTime VR since we took eight photographs at each point and the user can only turn in 45 degree increments, rather than smoothly. We also extended the idea to produce a way of accessing some of the contents of the National Disc, whereby the user could move around a computer-generated art gallery.
I had also hoped we might use the walk around a newly-built show house as a way of accessing information on sales of domestic products. Click on the TV and see the market for televisions. But we didn't have time to add that feature.
Crowd sourcing and Wikis
The internet provides an instant way of gathering information from people. Domesday aimed to do the same but using the Royal Mail as it's network. There were elements of a Wiki in the text pages of the Community Disc but, until now, there was no way for those pages to be rewritten and developed.
So it's a snapshot of a Wiki rather than a true Wiki but in the media landscape of the 1980s the notion of people writing whatever they wanted and it being published (and by the BBC at that) was very, very rare. And mentioning Wikis brings us back to where we started.
Like all innovative projects ... indeed like all projects of any kind ... Domesday was a mixture of existing ideas, ideas that developed from existing ideas, and new ideas. And it is important to remember that Domesday was a consumer product and was built with this in mind.
Could Domesday have influenced companies like Google? I did demonstrate it at America's main interactive video conference in 1988 and the project is often cited as part of what is known as the prior art when patents for interactive media are being considered in the USA.
Actually whether Domesday influenced 21st century interactive media is irrelevant. We tried out ideas that, in most cases, came around again and worked better because the technology was more suited to them.