Public Square is the right place to start understanding Watertown. It is not a grand urban plaza, but it still has the scale and confidence of a city that once grew rich on river power, rail links, and North Country trade.
Look for the older commercial facades around the square, then duck into the nearby Paddock Arcade. The area works best as a short walk rather than a single sight.