Colditz's market square is small, but it gives the castle visit some context. The houses around it show the older trading town that existed before the POW legend took over the name.
Use it as the start or end of the climb to the castle. There is not enough here for a long wander, but it is worth a pause if you want Colditz to feel like a town rather than a single exhibit.