Tonge was released by Simon Davey despite playing a vital role in the side that won promotion to the Championship under Andy Ritchie and finished the season at Gillingham.
He will now continue his career with The Millers who were relegated to League Two this season.