Delays will make 2012 'white elephant' fear a reality
But let's take a reality check: the company responsible for doing all the financial deals to make all of this happen is simply not being given the tools to do the job.
I have been talking to Baroness Ford, the head of the Olympic Park Legacy Company, which was set up more than a year ago.
I've known her for some time now. She's an experienced and tough businesswoman who rescued the Dome from financial disaster and has huge amounts of energy and enthusiasm for her Olympic role.
But when I talked to her this week, she was just angry and frustrated about the future of the Olympic Park.
The problem is that the last Government promised to hand over ownership of the Olympic Park to the OPLC, debt-free, so that it could do the financial deals to sell or rent out the venues to the private sector after 2012.
It's a pretty fundamental action to take. Would you be able to sell your house if you didn't have ownership of it or possess the deeds? No chance.
But the new coalition Government has now put that decision on ice, while the Treasury reviews financial decisions taken by Labour.
So the OPLC is trying to negotiate with companies about taking over the Park but it's unable to tell them that it has ownership of it.
The danger is that many of these companies will walk away because of all these complications. There are plenty of other projects to invest in in London at the moment and they are cheaper because of the recession.
Ford believes the problem has to be solved by the end of the this month when parliament goes on holiday. She fears, if it's not sorted out by then, it may never get sorted out.
I get the feeling, that after spending a year working the market hard, she is running out of patience with all this.
She told me she wasn't thinking of resigning but I wouldn't be surprised to see her walk away from the project if she is not allowed to do it properly.
And who would blame her?
She's been given the toughest job of all. Olympics in the past have been left with white elephants. Look at Athens 2004 which I have reported on before.
The experience from Athens is that you cannot wait until after the Games to do these financial deals. They need to be done in the next two years when the magic around the Games is there. Once the Games are over, it's much harder.
Ford keeps telling the Government this but nobody seems to be listening at the moment.