Robin van Persie scored twice from the penalty spot as Arsenal staged a remarkable comeback to knock Aston Villa out of the FA Cup.
Villa led 2-0 at the break through a Richard Dunne header and a finish from an acute angle by Darren Bent.
But three goals in seven minutes turned the tie upside down, Van Persie making it 2-1 after Dunne fouled Aaron Ramsey.
Theo Walcott levelled before Van Persie sealed victory with a second spotkick after Bent's foul on Laurent Koscielny.
WENGER'S WINNING RUN
Arsenal have only lost one of 34 FA Cup matches played at home under the stewardship of Arsene Wenger
Arsenal, 10-times winners of the FA Cup, will now visit the winners of next week's Middlesbrough-Sunderland fourth-round replay.
As for Villa, manager Alex McLeish will be wondering how on earth his side lost from a winning position.
McLeish denied Arsenal a first trophy since 2005 11 months ago when he steered Birmingham City to a famous win over the Gunners in last season's Carling Cup final.
But the Scot was the one left shell-shocked this time as Arsenal staged a magnificent fightback.
The Gunners were in desperate need of a lift after losing three straight league games, and the early exchanges suggested they were determined to make amends for their recent poor form.
Villa keeper Shay Given was forced into a stunning fifth minute save to keep out Thomas Vermaelen's 30-yard thunderbolt before Walcott was guilty of slicing a glorious opportunity wide.
The England international skipped past a challenge after Tomas Rosicky's 13th minute pass, but Walcott lost his composure at the crucial moment.
Villa had won on their last visit to the Emirates towards the end of last season but they were struggling to venture out of their own half as Alex Oxlade-Chamberlain flashed another chance wide.
DID YOU KNOW?
Arsene Wenger is seeking his fifth FA Cup triumph in his 16 seasons in charge of Arsenal
However, McLeish's side weathered the early storm before taking a firm grip with two goals in 12 minutes before half-time.
The visitors looked dangerous on the break through Bent and Robbie Keane, but it was a set-piece that undid the Gunners as Dunne broke the deadlock with a goal made in Dublin.
A well-worked corner saw Stiliyan Petrov's backheel release Keane, who floated the ball to Republic of Ireland team-mate Dunne, who headed home from close range.
It went from bad to worse for Arsenal when Bent then finished from an acute angle after his initial shot had been beaten away.
Villa's 5,000-strong travelling fans were in dreamland, but it was not to last.
Dunne, who had already been booked, was lucky to remain on the pitch after hauling down Ramsey inside the area, and Van Persie, himself fortunate to escape punishment for an apparent elbow on Carlos Cuellar, made no mistake from the spot.
And, within two minutes, Arsenal were level.
Walcott darted into the right side of the Villa penalty area and stabbed the ball across the goal-line, where Alan Hutton smashed his clearance back against the England forward and it ricocheted into the net.
Then, in the 61st minute, it was 3-2 after another well-executed finish by Van Persie from the penalty spot after Bent sent Koscielny sprawling.
And there was no coming back for stunned Villa as the Emirates celebrated one of the most dramatic victories in their six seasons at the venue.
- 21 Fabianski
- 04 Mertesacker
- 05 Vermaelen
- 06 Koscielny Booked
- 07 Rosicky (Arteta - 71' )
- 14 Walcott (Sagna - 89' )
- 15 Oxlade-Chamberlain (Henry - 89' )
- 16 Ramsey
- 17 Song
- 39 Coquelin
- 10 Van Persie
- 13 Szczesny
- 03 Sagna
- 08 Arteta
- 23 Arshavin
- 30 Benayoun
- 09 Park Chu-Young
- 12 Henry
- 01 Given
- 02 Hutton
- 03 Warnock
- 05 Dunne Booked
- 21 Clark
- 24 Cuellar
- 07 Ireland
- 19 Petrov (Bannan - 82' )
- 09 Bent
- 11 Agbonlahor (Gardner - 71' )
- 20 Keane
- 22 Guzan
- 30 Lichaj
- 32 Baker
- 25 Bannan
- 38 Gardner
- 18 Heskey
- 26 Weimann