On 12 August 1831, in Cincinnati, Ohio, he married Elizabeth Ramsey Irwin (18 July 1810 – 15 August 1850). He and Elizabeth had 10 children:
Archibald Harrison (1832–1870)
Benjamin Harrison (1833–1901); became president
Mary Jane Harrison (1835–1867)
Anna Symmes Harrison (1837–1838)
John Irwin Harrison (born & died 1839)
Carter Bassett Harrison (1840–1905)
Anna Symmes Harrison (1842–1926)
John Scott Harrison (1844–1926)
James Findlay Harrison (1847–1848)
James Irwin Harrison (1849–1850)