The former Nottingham Forest and Barnsley chief has held talks with the south London club..
David Tuttle quit the Lions on Thursday, after they were relegated to League One with two games of the Championship season to go.
Hart's agent Dan Fletcher told skysports.com: "They seem very interested in him and he's certainly very interested in them."