It was an up and down afternoon at the Furness Building Society Stadium but it ended with a high as Rovers won 4-3.
The visitors took the lead in the first half through a Adam Mekki penalty before a remarkable second half which saw Barrow lead 3-1 before three goals in added time saw Rovers take all three points.
Tranmere manager Gary Brabin made one change to the side which started against Macclesfield Town last weekend. Ben Tomlinson came in for Adam Mekki who was named on the bench but James Norwood was injured during the warm up and so Mekki took his place.
The pitch was deemed playable after a 9am pitch inspection but looked incredibly heavy with a couple of puddles in the goalmouth.
Rovers had the first eventful action of the game on 12 minutes when good interplay between Steven Jennings and Adam Mekki saw the latter shoot goalwards only for a deflection to see the ball turned home by Tomlinson but he was flagged offside.
The lead was established on 17 minutes when Jennings was fouled inside the penalty area by Neil Ashton. Mekki stepped up from 12 yards and sent the goalkeeper the wrong way.
On 26 minutes, Barrow had their first chance of the game when a cross from the right was headed over the crossbar by Andy Cook.
A few minutes later, Alex-Ray Harvey forced Scott Davies into a good save with a low shot from 25 yards.
Rovers went down the other end and Jeff Hughes burst forward and fired a vicious shot just over the crossbar.
Barrow forced a bit of pressure at the end of the first half with a series of corner kicks but Rovers defended well to go in at half time with the one-goal lead.
Tranmere had the first chance of the second period as Hughes played Tomlinson in down the right side of the box but the forward's shot took a deflection wide for a corner.
On 63 minutes, a Tranmere corner from the right was quickly taken and the ball found its way to Jay Harris on the edge of the box but his shot was straight at Joel Dixon in the Barrow goal.
Midway through the second half, Barrow were awarded a penalty after substitute Jason Walker went down in the area. The same player stepped up and fired home from 12 yards.
Barrow took the lead on 82 minutes when Andy Haworth's cross was headed home by Simon Grand.
A couple of minutes later, an almighty goalmouth scramble saw a number of Tranmere efforts blocked on the line before Barrow cleared their lines.
The hosts extended their lead with three minutes remaining when a quick breakaway saw a right wing cross turned home by Andy Cook.
Rovers scored on the stroke of normal time when a ball forward was well held up by Hughes and Lois Maynard fired home on the half volley to half the deficit.
With the next attack, Rovers equalised when Ashton failed to clear and Hughes nipped in and took the ball around Dixon before slotting it into the net.
And the action wasn't finished there when in the final minute of added time, Jake Kirby, who had only recently entered the fray, hit a shot from 20 yards which took a deflection and went past Dixon for the wnner.
It's a funny old game, ups and downs in a matter of minutes but Rovers took three points.
Barrow: Dixon, Cowperthwaite, Ashton, Grand, Harvey (Haworth 53), Cook, Pilkington (Walker 60), Mellor, S Williams (O'Reilly 13), Symington, J Williams. Substitutes: Walker, Fofana, Grimes.
Tranmere: Davies, Vaughan, McNulty, Ihiekwe, Hill, Maynard, Jennings, Harris, Tomlinson (Stockton 77), Mekki (Kirby 85), Hughes. Substitutes: Turner, Sutton, Riley.
Referee: Karl Evans
Yellow cards: Hughes (54), J Williams (76)
Goals: Walker (67 pen) Grand (82), Cook (87); Mekki (17 pen), Maynard (90), Hughes (90+2), Kirby (90+5)