His wife Julia Boggs Dent Grant born January 26, 1826 was the First Lady of the United States from 1869 to 1877.

In 1823, his family moved to the village of Georgetown in Brown County, Ohio, where five more siblings were born: Simpson, Clara, Orvil, Jennie, and Mary. Young Grant regularly attended public schools and later was enrolled in private schools.