Norwich is the natural day trip from Great Yarmouth — a proper medieval city with a cathedral, a castle museum, and one of the most complete historic street plans in England. The train takes 30 minutes and runs frequently.
The Norfolk Broads extend west from Yarmouth and can be explored by hired boat from several points along the River Bure. Acle and Wroxham are popular starting points if you want a full day on the water.