Paul Connor and Gareth Griffiths scored the goals that gave them a 2-0 victory over Coventry, who are pushing for promotion back to the Premiership at the first attempt.
It was a case of Deja Vu for City fans, 32 years ago Dale knocked them out of the same competition albeit with a 2-1 scoreline.
Shrewsbury will host Chelsea tomorrow evening in a match that will be shown live on BBC One, and will be hoping to join Dale in the hat for the fifth round.
Yesterday was not a big day for upsets in the cp, with the two remaining non-league sides crashing out.
Dagenham & Redbridge were unlucky to lose out at Norwich City thanks to a 89th minute strike, while Farnborough Town went down 5-1 at Highbury.
Blackburn Rovers came from 3-0 down to draw with Sunderland, forcing a replay back at the Stadium Of Light.
Ex-Iron's Guy Ipoua and Chris Hope will enjoy a day out at Elland Road after holding Leeds United to a 1-1 draw at Priestfield, Ipoua missed a golden opportunity to score when he lashed the ball against the post from three yards out.
Southampton must also replay their game, facing a testing trip to the New Den to play Millwall.
Elsewhere Burnley beat Brentford, Sheff Utd overcame Ipswich in a 4-3 thriller while Walsall, Watford and Wolves all secured places in the next round.
As well as the aforemention Shrewsbury/Chelsea game tomorrow there are four other games: Crystal Palace v Liverpool; Fulham v Charlton; Man Utd v West Ham United; Stoke City v Bournemouth.