Swimmers should be banned from crossing the Channel from Dover to Calais, according to the French coastguard.
People attempting the 21-mile challenge have to cross the world's busiest shipping lane.
Deputy director of the French Coastguard Jean-Christophe Burvingt told BBC South East's Inside Out he feared there could be an accident.
But Mike Oram, of the Channel Swimming and Piloting Federation, said the crossings were safe and well organised.
More than 500 vessels pass through the shipping lanes each day.
Mr Burvingt said: "This continuous increase of swimming in the Channel creates a danger which is getting more and more important every year.
"I think that there will be a collision. There will be an accident due to that [cross-Channel swimmers]."
France banned swimmers using the Calais to Dover route 17 years ago.
Kaimes Beasley, of the UK's Maritime and Coastguard Agency (MCA), said cross-Channel swimming was "as dangerous as trying to cross the M25".
Some ferry operators have also warned that a swimmer could cause a major accident.
Chris Newey, of DFDS Seaways, said: "We'd like to see some control over the numbers of people that are doing this activity, and when they're doing it, and some regulation around that activity from a health and safety perspective."
The Channel Swimming and Piloting Federation, which accompanies swimmers and is one of two regulatory bodies authorised to organise and assist swims and other crossings, said the challenges were as safe as could be.
"We are over the top with all our safety precautions," Mr Oram said.
"We have tracking systems on the vessels, we have everything else that is required, we report into the coastguards.
"They know well in advance exactly what we're doing and how we're doing it and there is a restriction on the number of pilot boats."
He added that the number of swimmers had reached a peak and figures had stayed roughly the same for the past four or five years.
No swimmer or support boat has ever caused an accident in the English Channel to date, but the MCA has said "swimmers should be persuaded to look for a challenge elsewhere".
Below is a selection of comments sent to the BBC News Website
My charity is supporting a blind swimmer, Steve McCarthy in his attempt to swim the English Channel in 2012 to become the first British blind person to achieve the feat (he is also supported by actor David Walliams). We would be horrified at a ban. So long as attempts are well planned and supported then we don't see the health and safety issue as a valid reason to ban it. Jonathan Waddington-Jones, Bournemouth
I swam the channel in 2004. In all fairness I remember it to be rather dangerous. There were literally tankers metres away from me. However, among all of this I remember the pilot boats to be vastly qualified, in radio contact with all around us and I never felt in any danger whatsoever. Jamie Thomson, Ramsgate, Kent
The swim is arduous and it is the World's leading long distance swimming challenge. All solo swimmers have to prepare for the worst and hope for the best, knowing that the pilot boat and their crew will keep both you safe and other Channel shipping. It would be appalling if this tradition was to be ended because of a perceived risk that has been managed to zero incidents. Bryn Dymott, St Neots
This is a very safe and well organised challenge. It is a legitimate activity. The coastguards on both sides of the channel should be told that their job is to facilitate safe passage not limit it. Howard, Swansea
I'm not a swimmer, but these concerns seem legitimate. There is a simple solution to this issue though, organise specific periods around the year where swimmers are allowed to cross the channel, and ban it at all other times. Should work well for everyone involved. Alvaro Neto