All Saints' is the oldest substantial building on The Square, completed in 1914 in Gothic Revival style after the original wooden 1875 church burned down. The building is faced in local limestone and roofed in shingle slate, with a tall spire that is one of the city's few real landmarks.
The interior is small but handsome, with a hammer-beam ceiling and good Victorian stained glass. The church is generally open during weekday office hours and remains the central Anglican parish of the city; choral evensong on Sunday afternoons is a good way to hear the small choir at work.