The 32-year-old former Hartlepool and Norwich defender has joined the Valley Parade outfit on an 18 month deal.
After leaving Glanford Park, Nelson went on to win the Scottish League Cup with Kilmarnock, beating Celtic in the final in 2012.
Nelson made 30 appearances for Scunthorpe, scoring one goal against Wycombe Wanderers.