Castell d'Agost is a small ruined Moorish fortress on the hill above town. Little remains beyond foundations and part of the outer wall, so come for the setting rather than intact architecture.
The climb rewards you with good views over Agost and the surrounding dry hills. It pairs naturally with the pottery museum and the old pottery street below.