The 98 buildings making up the village follows the main road and follows northwards along Church Lane, close to the church.
Nearby is the famous Baylham House Farm, Mill Lane, also known as Rare Breed Centre ( northeast from the village) on the other side of the B1113.
The church of St Peter is at west end of the village, on a hill just off Church Lane. It was constructed in late Romanesque style in the 12th century; had Gothic style windows inserted in the 14th and 15th centuries; and was restored in the 19th century.
Baylham common is 100 metres further west than the church on the other side of the road.