The Botanical Garden of Tver State University is a quiet detour on the north side of the river. It is not a showy, big-city botanical garden, but it has mature plantings, greenhouses, and enough shaded paths to justify the walk if you are already exploring the embankments.
It is best in late spring and early summer. Outside the growing season, treat it as a calm local park rather than a major attraction.