In December, 1866, he married Mary F. Pannell, a native of Todd county, Kentucky, and daughter of Moulton Pannell. They have five children, all living, four sons and one daughter: J. W., J. M., Lonzo E., Walter A., Susan J.