Torgau's market square is the town at its most composed: Renaissance town hall, old pharmacy, and handsome burgher houses gathered around a broad civic space. It is a good pause between the castle and St Mary's.
The square does not need much interpretation. Sit with a coffee if the weather is kind, then use the surrounding lanes to wander the compact old centre.