Kütahya Archaeology Museum is small but worthwhile, especially if you are heading to Aizanoi or have just returned from it. The displays cover the region from prehistory through the Byzantine period, with pottery, coins, gravestones, and Roman sculpture.
The building helps. The old medrese gives the collection a compact, sheltered setting right beside the Great Mosque, so it works well as part of a short walk through the historic centre.