Takeo City Library is not a must-see in the old monument sense, but it is a useful modern counterpoint to the onsen and shrine. Its bookshop-cafe model made it unusually famous for a small-city public library.
Drop in between sights, especially if the weather is poor. It is also one of the easiest places in town to sit down without turning the pause into a full meal.