Threave Castle is a stern 14th-century tower on an island in the River Dee, built for Archibald the Grim, Lord of Galloway. Its setting does half the work: you walk through low river country before the ruin appears across the water.
Access to the castle can close for conservation, so check before counting on the boat crossing. Even then, the riverside walk and view of the tower still make the trip worthwhile.