Tesco, Sainsbury's, Asda and Morrisons all saw sales drop in the three months to 11 August, according to data from research firm Kantar.
Morrisons recorded the biggest fall of 2.7% followed by Tesco.
Fraser McKevitt, head of retail and consumer insight at Kantar, says: “The memory of last year still looms large for retailers and this summer’s comparatively poor weather, combined with low levels of like-for-like price rises, have made growth hard to find for retailers".
In contrast, the German discounters Aldi and Lidl made big gains, with sales up 6.2% and 7.7% respectively.
Mr McKevitt said Lidl was boosted by opening new stores as well as a drive to persuade customers to do their "big shop" at its supermarkets.
He said the average basket spend is now nearly £19, 3% higher than last year, "though still significantly lower than the £22.65 average spend at the big four".