Overbury's Folly is a terraced seaside park built around the town's best easy viewpoint. It is not grand in the formal sense, but it gives you the Arabian Sea, the old harbour edge, and a place to let the town's heat and traffic fall away for a while.
Come late in the afternoon if you can. The light is kinder, the sea breeze helps, and the fort-and-pier walk makes more sense when it ends with a view.