Cheb Museum is the town's main local-history stop. Its collections include paintings and material tied to Cheb's past, useful context in a town where Czech and German histories sit close together.
It is a good rainy-hour addition rather than the reason to come. Pair it with the castle and main square.