St Nicolas Church is one of the old centre's main landmarks. Wikivoyage notes its 13th-century origins and later Baroque form, which is a fair summary of Cheb itself: medieval bones under later layers.
It is close to the square, so there is no need to make a separate expedition. Step in if it is open, or use it as a marker while walking the old lanes.