St Mary in the Castle is a Grade II listed former Georgian church set below Hastings Castle in Pelham Crescent. The building now works as a gallery, theatre, and performance space, so it is worth checking both for the architecture and for whatever is on during your visit.