The Pamir Botanical Garden climbs a dry hillside east of town, high enough that Khorugh drops away below you and the Afghan border valley opens out in front. It was founded in 1940 to test which plants could survive mountain conditions, and the collection still gives the place more purpose than a normal viewpoint.
Come for the setting as much as the botany. Paths run between poplars, fruit trees, hardy shrubs, and experimental plots, with enough shade to make it a gentle half-day walk. It is best early or late in the day, when the light softens the brown slopes around town.