The Albany Museum is one of South Africa's older museum institutions, tied to Rhodes University and spread through several collections. It is strongest when you want context: natural history, local archaeology, settler history, and the Eastern Cape's layered past.
Do not expect a slick big-city museum. The value is in the depth of local material and in seeing how Grahamstown has tried to tell its own story.