This hasn't been such a problem at previous Olympics, as the allocation of tickets given to British spectators has usually been sufficient.
David Hoy is also complaining about Locog's policy, which is currently under review, of charging babies the full price for a seat at the Games. Sir Chris Hoy's niece is four months old.
David Hoy said: "It's crazy. She'll just sleep on someone's shoulder, so there will just be an empty seat which could go to somebody desperate to see the Olympic racing."
These comments from the father of such a well-known British Olympian will increase the pressure on Locog to review their policies for babies, and also the families of athletes.
David Hoy says that his message to Locog is simple: "Please consider how you would feel if your son or daughter had worked for 10 or 12 years and slaved, trained really hard, got to this level, and then you were told 'Really sorry, you're going to have to sit and watch it at home'.
"Just imagine how you'd feel and do something about it, please."
This page is best viewed in an up-to-date web browser with style sheets (CSS) enabled. While you will be able to view the content of this page in your current browser, you will not be able to get the full visual experience. Please consider upgrading your browser software or enabling style sheets (CSS) if you are able to do so.