Harrogate Town were held 3-3 as ten-man Blyth equalised with five minutes left.
Peter Bore and Callum Hassan put Town 2-0 up early on but Town were pegged back to 2-2. Laurie Wilson made it 3-2 but Dave Coulson earned Blyth a point.
Town manager Simon Weaver told BBC Radio York: "I'm disappointed because we scored three goals away from home and played quality football.
"We're like two different teams at the minute, going forwards we're really good but at the back we're shaky."
Town looked to have survived squandering their early lead when former Town player Wayne Phillips was dismissed, with Town going 3-2 up afterwards.
"We've got to tighten up, I'm very disappointed with the goal we conceded when they were down to ten men.
"It's not all shocking and it's not all brilliant. There are positives going forwards."
Town have scored ten goals and let in eleven in six games, prompting Weaver to add: "The results don't lie. There's a lot of evidence with the goals for and the goals against."
The draw leaves Town in 12th place in Blue Square Bet North, ten points behind leaders Hyde, where they go next, and eight points above bottom club Solihull Moors.