Ryan Lowe's 18th goal of the season earned Rovers a 2-2 draw against Oldham.
The striker headed in Tranmere's second equaliser of the match with a quarter of an hour remaining after Jason Koumas had earlier scored a deflected effort to bring Rovers level at half time.
There were two changes to the team that defeated Coventry City. With Matthew Pennington and Matthew Kennedy having returned to Everton, Danny Holmes and Andy Robinson started at right back and left wing respectively.
An early shot from Danny Philliskirk deflected off the back of Stephen Arthurworrey and looped away from Owain Fon Williams but the keeper reacted quickly and gathered at his right hand post.
Jonathan Grounds almost turned a left wing cross from Liam Ridehalgh into his own goal on nine minutes, but soon after the visitors took the lead. A throw in was taken quickly on the left and the ball played to James Wesolowski who fired into the bottom left corner from the edge of the area.
After trying to battle their way back into the game, Rovers found an equaliser on 30 minutes. Ryan Lowe did well to keep the ball in play on the right and he found Jason Koumas on the edge of the area whose first time shot deflected off Jonathan Grounds and over Mark Oxley into the net.
Steve Jennings fired wide of the target from 30 yards on 37 minutes after winning possession just past the halfway line, while an overhead kick from Stephen Arthurworrey from a Koumas corner went over the bar five minutes later.
Rovers started the second half the brighter of the two teams and Arthurworrey rose above his marker to head over from a Koumas corner on 54 minutes.
However, four minutes later the visitors went back ahead. A right wing cross from Philliskirk reached Taylor at the near post and his clearance smashed against Liam Ridehalgh and rebounded past Fon Williams and into the far corner of the goal.
A Taylor back post header deflected away from goal on 61 minutes while Wallace shot wide from the edge of the area following a scramble nine minutes later.
Jake Kirby replaced Koumas on 70 minutes as Rovers switched to 4-4-2. Five minutes later Tranmere were level. Cassidy superbly brought down a Holmes clearance and raced up the right wing. The striker off a defender and curled in a cross with Lowe heading past the keeper from six yards.
Lowe forced the keeper into a save with a drilled shot from a tight angle on 84 minutes and Cassidy's near post effort had to be turned behind for a corner a minute later as Rovers pressed for the winner.
At the other end David Worrall headed into the side netting from Jonson Clarke-Harris's left wing cross, while a late cross from Jennings went through a crowded area and just past Kirby at the far post.
Tranmere: Fon Williams, Holmes, Taylor, Arthurworrey, Ridehalgh, Lowe, Koumas (Kirby 70), Jennings, Wallace, Robinson (Rowe 89), Cassidy. Unused substitutes: Mooney, Horwood, Goodison, Power, Stockton.
Oldham: Oxley, Brown, Grounds, Wesolowski, Smith, MacDonald (Clarke-Harris 84), Mellor, Harkins, Philliskirk, Worrall, Lockwood. Unused substitutes: Rachubka, Winchester, Dayton, Dunfield, Stead, Clarke.
Referee: Charles Breakspear
Yellow cards: Robinson (3), Taylor (39), Wesolowski (49)