Värmlands Museum is the place to understand the province around Karlstad. It covers regional history and culture, but also runs a steady programme of art and photography exhibitions, so it is not only a local-history stop for rainy afternoons.
The museum's position on Sandgrundsudden helps. You can move from the galleries straight back to the Klarälven, making it part of a good central walk rather than a detour.