The remains of a house, which tradition states belonged to the Black Friars or Friars' Preachers, the walls alone standing, lie beside the town's cricket field. There is a 14th century cellar. The Black Friars came to Winchelsea in 1318 but did not acquire the house on this site until the middle of that century. Their house, together with the Grey Friars, fell at the Dissolution and was granted into private hands.

The buildings were probably used to provide stone for the extension of Camber Castle in 1539.