This paper describes the development of a methodology to measure the perceived quality of television subtitles based on well established guidelines for measuring perceived audio quality. The aim was to estimate the relative impact of reducing the delay in the appearance of live subtitles as against an increase in the accuracy of the subtitles. The results show a clear difference in the impact of timing and accuracy for our audience depending on whether they are watching television with the sound turned on or off. For those watching with sound the timing is the most important whilst for those watching with the sound off the accuracy is the key factor.

This paper was originally published at IBC2013.