In an exclusive interview in New York, which will be aired on
BBC's Football Focus
in the coming weeks, the left-back said his mother found it difficult to read some of the stories written about him.
"What parent wouldn't?" he said. "But at the end of the day I just want to play football, I'm here to play football.
"I just wish people would judge me more on football and speak about football more than a life that people don't really know."
Cole was also adamant that the shooting incident was blown out of proportion.
"If someone had actually seen the incident - you wouldn't laugh because it was a stupid thing to do - but the whole situation was crazy. Of course it was an accident," he insisted.
"But if I wanted to address every single thing in the paper I'd lose my mind. It makes me crazy now when I hear things.
"But like I say, you've just got to deal with it. I'm just here to play football. That's all I want to do."
Cole was in New York to meet US rapper Jay-Z because the pair are opening a restaurant in London next year. They were brought together by NVA Entertainment's Chris Nathaniel, an entrepreneur working in the sports and music industry.
Ashley Cole factfile
Made his debut for Arsenal in 1999, aged 18
Moved to Chelsea in August 2006
89 international caps for England
Won three Premier League titles and six FA Cups
The restaurant will provide jobs for young people from underprivileged backgrounds and a donation will be given to charity each month from the profits.
Cole insisted the project was not about rebuilding his public image.
"I don't do things to try and get publicity or anything like that. It was a great way for me to be working with people like Jay-Z and with great entrepreneurs who are going to try and make this restaurant a success," he said.
"I know how hard it is to get a job because my mum had chances to get a job and never got them so hopefully I can give something back and this is a great way of doing it."
Cole also admitted he did "not know too much" about Villas-Boas, the 33-year-old who was named Chelsea manager in June.
Cole said: "I know he was a scout when Jose Mourinho was there [as Chelsea manager] and I used to see him about. But then he went to a lower club in Portugal [Académica de Coimbra] and got them up, then won the triple with Porto, so he's got a good CV under him.
"But whoever it was coming in, we're just going to play as hard as we can and try and win trophies.
"I don't think age matters. A lot people know him from his time at Chelsea. From what I do remember, he is a great guy and he's friendly. So it doesn't matter about the age - we're all just going to play. He's the manager and we got to respect him and do the best that we can for him.
"In football, this is what happens. You have managers and they come and go. Of course you're going to miss them because you had a good relationship with them. But this is football and hopefully I can have a great relationship with this guy."
This page is best viewed in an up-to-date web browser with style sheets (CSS) enabled. While you will be able to view the content of this page in your current browser, you will not be able to get the full visual experience. Please consider upgrading your browser software or enabling style sheets (CSS) if you are able to do so.