The current St Peter's Church dates from 1725 and replaces an earlier building lost in the 1692 earthquake. It is a low, sturdy stone building, plain on the outside but with a surprisingly elegant interior featuring a wooden organ loft and a silver communion plate said to have been donated by the buccaneer Henry Morgan.
The churchyard contains gravestones from across the colonial period, including those of sailors, naval officers, and some of the few buccaneers buried on consecrated ground. The most famous tombstone — that of Lewis Galdy, a Frenchman swallowed and then spat back out by the 1692 earthquake — is here. His epitaph is one of the great curiosities of Caribbean tombstones.