Tranmere Rovers were knocked out of the Emirates FA Cup by a stoppage time goal at Stevenage in the First Round on Saturday.
Luke Norris recovered from injury in time to make to the starting line-up for Tranmere on his return to the club he left in the summer.
Stevenage opened the scoring after three minutes when Elliot List crossed in for Jordan Roberts to nod home.
Rovers went on the attack in response, going close with a shot from Paul Lewis on the edge of the box, but the effort was narrowly over the crossbar.
Lewis had to make way shortly after through injury and was replaced by Chris Merrie.
Rovers won a penalty on 28 minutes when Norris was brought down in the box, and returning to his former club, the striker stroked home to equalise.
Stevenage looked to attack from the wings but Rovers kept shape well to keep them at bay for large parts.
Rob Apter’s runs on the right frequently dazzled Stevenage defenders and helped Tranmere take several looks at goal, before the teams went in level at the break.
Apter put Rovers in the lead shortly into the second half with an excellent strike into the top corner.
Stevenage levelled almost immediately after, Jamie Reid scoring from the spot.
Tranmere were forced to soak up extended spells of pressure from the hosts in the second half, and eventually went behind to a Kane Hemmings goal on 81 minutes.
Nigel Adkins made a triple change as we approached nine minutes of stoppage time, James Norris, Kieron Morris and Charlie Jolley coming on for Regan Hendry, Connor Jennings and Rob Apter.
Morris equalised for Rovers just seconds after entering the field of play to make it 3-3 in stoppage time.
The hosts took the contest at the death, Reid scoring the winner ten minutes into added time.
Stevenage: Taye Ashby-Hammond, Dan Butler, Carl Piergianni, Alex MacDonald, Elliot List, Nick Freeman, Jordan Roberts, Kane Smith, Terence Vancooten, Jamie Reid, Louis Thompson.
Subs: Krisztian Hegyi, Nathan Thompson, Finley Burns, Harvey White, Harrison Neal, Ben Thompson, Reece Hannam, Charlie McNeill, Kane Hemmings.
Tranmere Rovers: Luke McGee, Lee O’Connor, Tom Davies (C), Jordan Turnbull, Dan Pike, Brad Walker, Paul Lewis, Regan Hendry, Rob Apter, Connor Jennings, Luke Norris.
Subs: Joe Murphy, Kieron Morris, Charlie Jolley, Kristian Dennis, Chris Merrie, Sam Taylor, Joe Yarney, James Norris, Connor Wood.
Attendance: 2404