February 10, 1857, he married Mary Ann Staples, daughter of Col. James Staples, a native of Henry county, Virginia. They have six children, four girls and two boys: Mamie, Virginia, Annie Bird, May S., Thomas, and Henry H., Jr.