↑Allred, p. 18, has nothing on George except his birth date, and no obvious record is found after 1855.
The 1880 census shows a George Ball in Barre (here, line 17) who is single, but his age is one year off, and he cannot be matched to previous censuses to show where he came from. This doesn't seem promising.
A George Ball is found in Connecticut in 1860, a travelling merchant, whose birth is 1830 in Massachusetts. He had married a Clarissa Ball, d/o William and Julia Moore of Stafford, CT, and stayed there until he died in 1895, with no apparent issue. (1860, line 27; 1870, line 1; 1880, line 8; their gravestone) This seems like a good candidate, but no marriage record has been found, there seems to little information on him even on Internet trees, and a connection across state lines with no evidence is pretty speculative.