United's 2-2 draw with Queens Park Rangers at Glanford Park on Saturday means they are now just three points above the relegation zone.
But Paterson, who scored the first of the home side's two equalising goals against the Rs, feels his side just aren't getting the breaks at the moment.
"We deserved to win the game, and we're trying as hard as we can," he said.
"I know I can't try any harder and the rest of the lads are the same.
"We're working as well as we can and we're not worried about getting dragged into a relegation fight, we're just worried about winning games.
"And if we can do that we know we won't just be able to just survive in this league, but we can do something in it too.
""The fans boo us because they're used to winning games. We're frustrated but we have great team spirit. If the league was judged on spirit we'd win it."