At the beginning of the 16th century, the Dominicans were offered the old church dedicated to the Annunciation and a sizeable house by the Confraternity of the Annunciation. The friars accepted the offer and took possession on 4 February 1528.

During one of the attacks on the HMS illustrious on Sunday, 19th January 1941, the convent and the church were hit and reduced to a pile of rubble.