The ruined Bishop's Palace, in the angle between the cathedral and the south face of the cliff, was once one of the most important episcopal palaces in medieval England — the centre of the largest diocese in the country, stretching from the Humber to the Thames. The hall, undercroft, kitchen tower, and chapel are all clearly identifiable in the surviving walls; some sections were destroyed in the Civil War and never rebuilt.
The site is managed by English Heritage; an audio guide walks you through the buildings and the long episcopal history. The terraced gardens on the south slope hold a small working vineyard — said to be the most northerly producing vineyard in Britain — and a long view out over the Witham valley. Combine with a visit to the cathedral.