On January 25, 1812, he was married to Ellen Matlack Stretch, the granddaughter of Col. Timothy Matlack, the Revolutionary patriot. After fifty years of wedded life, January 25, 1S62, Col. Abert and his wife celebrated their golden wedding in their elegant home. No. 1731 "I" street, in Washington city. His sons served with distinction in the United States army during the Civil war.