St. Botolph's church stands near the site of a Roman villa that stretches towards Clopton churchyard. It dates from the 14th century and is a grade II* listed building. The body of Saint Botolph is supposed to have lain in the church until 680, when it was removed by monks from the abbey at Bury St Edmunds.
The population of Burgh is about 200. Because of its small size, there is no parish council, and no parish rate is levied. Instead, there is a Parish Meeting to which all villagers are invited. This meeting occurs two or three times a year. During these meetings, residents are welcome to discuss the issues, problems, concerns and affairs of the village.
Several artists and craftsmen live and work in the village.