St. Paul's Church stands near the lake on the edge of the temple complex area, a solid neo-Gothic structure built by the British colonial administration in 1843. The interior is modest but cool, with stained glass windows and memorial plaques to British soldiers and administrators. The churchyard is worth a slow walk for its inscriptions.
The church is still active and holds English-language services on Sundays. It is freely accessible most days and makes a quiet contrast to the busy Buddhist sites surrounding it. The gardener is usually around and can often answer basic questions about the history of the graves.