Abbey House and its grounds, not to be confused with Bermondsey House, stood to the east of the parish church of St Mary Magdalen.

It was probably the grandest house in the parish in the early 19th century, but the house was demolished and the estate developed in the 1840s and 1850s.

The house backed onto the churchyard of the parish church.