Son of Abner Hulen Lester Sr. (1792-1873) & Rebecca Whitt Lester (1795-1844).
Brother of Thomas Mastin "Chet" Lester (1815-1884), William Riley Lester (B. 1817), Susannah Lester (B. 1920), Martha Ann Lester (1820-1906), Mary "Polly" Lester (1825-1894), Louisa Lester (B. 1827), Abner Hulen Lester Jr. (1829-1902), & Pricy Lester (1837-1910).
Married to Emily Ann Jones (1839-1894) on Oct. 16, 1856.
Father of Martha Jane Lester (1857-1857), Lewis McHenry Lester (1858-1873), George Thomas Lester (1861-1952), Burrell Franklin "Burl" Lester (1865-1961), John William Lester (B. 1866), Richard Thornsberry Lester (1869-1956), Joseph Sampson Lester (1875-1937), Manvell Harmon Lester (1878-1878), & Barbara Cosbi Jane Lester (1879-1964).