The Wirrall outfit are only out of the relegation zone thanks to having a better goal difference than Bristol City and Gillingham.
Little said: "It is very frustrating and disappointing. We're just going to sleep in every game we play and that mistake is being punished.
"We've got to dig in, it's the only thing we can do. It's a real test for me.
"I came into the club in a position a couple of places lower than this and hadn't really looked back since, until this last month when everything seems to have gone wrong.
"All I want to do is try to get the team up the League. The fans pay their money to have a shout and they're entitled to have a shout at the moment."
Little will recall defender Paul Linwood from his loan spell at Wrexham ahead of Friday's game, after Mark Rankine pulled his hamstring.