The 25-year-old is out-of-contrace at the Bees, who were relegated to League Two this season.
Kuffour still managed to grab 14 goals for the London side, and is setitng his sights higher than the Galpharm Stadium.
Terriers boss Andy Ritchie said: "His agent tells me he wants to go to the Championship and if he cannot get fixed up at that level, that he wants to stay around the London area."