Tsuyama Railroad Educational Museum is a good specialist stop, especially if you arrive by train. Its main draw is the old roundhouse and turntable, with locomotives and rolling stock displayed in a way that makes the railway infrastructure part of the exhibit.
It will not convert everyone into a rail fan, but it adds variety to a castle-and-garden day and is close enough to the station to visit before leaving town.