Vevey makes an unusually good base for the eastern end of Lake Geneva. Montreux and Chillon Castle are 10 minutes away by train. Lausanne, with its cathedral and the Olympic Museum, is a quarter of an hour west. The Lavaux vineyard terraces — a UNESCO world heritage site — start just outside the town and can be walked or visited by tourist train.
For something higher, take the train up to Les Pleiades or Mont Pelerin for Alpine views, or continue to Gruyeres, an hour and a half away, for cheese and a fortified medieval village.