The Lower Manor House stood near the present Old Road near the junction of Rotherhithe New Road with the (Deptford) Lower Road.

When first built it was in a most isolated position with only a windmill for a near neighbour.

Despite intensive building in the 19th century the house survived until at least 1870.

Watercolour painting by G.Yates, 1826.