... He married Sally Ann Fisher in 1822. She was the granddaughter of former Governor George Truitt.[citation needed] They had two sons, James and Charles, but she died two weeks after the birth of Charles. Clayton never remarried and raised the two boys himself. ...