Bury scored twice in the final eight minutes to beat Stevenage and move off the bottom of League One.
Steven Schumacher missed a penalty for Bury after being fouled by Gavin Mahon.
Craig Jones scored his first senior goal from eight yards after David Worrall had drilled the ball into the Stevenage box.
Substitute Johnson Clarke-Harris secured the win when he sprinted clear of the Stevenage defence and buried a low shot into the corner.
VIEWS FROM THE DRESSING ROOM
Bury coach Ben Futcher told BBC Radio Manchester:
"In the last two games, we've created so many chances. To see one go in - everyone was delighted.
"Then the next chance went in as well so we're absolutely delighted. The lads deserved the three points tonight.
"We've got to carry it on. We need some wins from the last eight games and we move onto Saturday in a positive frame of mind."
Stevenage manager Gary Smith told BBC Three Counties Radio:
"It continues our long run of Jekyll and Hyde performances.
"It bore no resemblance to what they saw in the (4-0) win over Sheffield United on Saturday.
"The challenge for the players and staff is to find that consistency and so far we haven't found it.
"At this level you have to expect that it's going to be competitive and security of possession makes a lot of difference - and Bury did it better.
"When we got into advanced positions we looked toothless and when the opportunities did come along, quality failed us. At the other end we looked as unreliable as we have for a long time."