However, City are currently only sixth in the division, two places behind us, and are stuck in a poor run of form which will see them out of the playoffs within a fortnight.
Former United manager Dave Moore, who was joint assistant manager at the club along with Kevan Smith, has also left the South Yorkshire club.
Chairman Adam Pearson has said that he and Little had differences of opinions on certain issues.
"It's been a disappointing day and it's never easy parting company with somebody but we both felt that it was in the best interests of the club," said Pearson.
"We are still in the play-offs and we'd be delighted to finish there at the end of the season so it may appear a strange decision but both Brian and I felt that it was the right time even though there are only 11 games to go.
"We feel that if we freshen it up a bit now, we can still make the play-offs."
A Iron/Hull clash in the playoffs would certainly be a tantalising prospect for both sets of supporters, however they will be lucky to pick up their form to enough to make an impression.
Brian Little has been diplomatic on his exit, but did concede that he was disappointed to leave the club.
"From my point of view it's a pity that I'm not part of the future of the club but I hope everyone will think I've done my little bit," said Little.
"Some might think I should have done more, but maybe the majority of people will think I've done something."
Speculation as to the new manager already seems slightly too ambitous for the club, though Pearson will not name the new gaffer until the summer.
Youth team coach Billy Russell will take control of first team affairs until the end of the season.
Which division they play in will obviously have a huge impact on the type of manager they can bring in, the better managers can be wiped off the list then.
Ronnie Moore, manager of first division Rotherham United, has been suggested. Although it is had to see why he would leave a succesful Millers outfit who he has guided from the third division to the first in consecutive seasons for 'Ull.
Our very own Brian Laws has also been mooted as a candidate, with a number of Hull fans admitting a grudging respect for the man who has built a side capable of promotion on a shoestring.
However, Laws knows better than to leave us for City. Even though had he been handed £1million to spend by Steve Wharton he would surely have us top of the league by now.
Cheltenham's Steve Cotterill is another name in the frame, though we quite fancy Bungle from Rainbow to be a suitable replacement.
Failing that, maybe the monkey from the ITV Digital adverts.