Victoria Bastion is part of Narva's old defensive ring, built when the city was a Swedish stronghold guarding the river frontier. The surviving earthworks and casemates give a different angle on the city from the castle: lower, more military, and closely tied to the riverbank.
Tours of the casemates run seasonally and are worth taking if available. Even without a tour, the bastion area makes a good walk between the castle, Pimeaed park, and the promenade, with views across the river and back towards the town.