The Kuldīga District Museum sits in the castle park near the Venta, close to where the medieval castle once stood. Its displays are small but useful, especially if you want more than a postcard version of Courland town life.
The best reason to stop is context. After the old streets and bridge, the museum helps connect Kuldīga's river setting with its time as a local centre of the Duchy of Courland.