The cathedral, Guildhall, museum, and central churches are walkable from the railway station. For Flag Fen, Nene Park, and Longthorpe Tower, use buses, a bike, taxi, or a car; the city spreads out quickly beyond the centre.
Peterborough's Green Wheel cycle network is useful if you like exploring by bike, especially along the Nene and out toward the country parks.