The Tigers powered to a 4-1 victory at the KC Stadium to complete a 6-1 aggregate success, but Brown is aware that there is one more game to come, with a Wembley date with Bristol City ahead.
Brown said: "I feel like I'm putting a dampener on it when we haven't done the job yet.
"It's great getting to Wembley and it's one of the milestones that we needed to achieve and we've achieved it.
"But as I've said before, nobody remembers a losing finalist. We've got go there now with a game-plan and finish the job."