Spadina House Museum sits beside Casa Loma and shows a more lived-in version of Toronto's upper-class past. The restored rooms, gardens and household details cover the early 20th century without the theatrical castle atmosphere next door.
It is a good companion to Casa Loma if you want history rather than spectacle. Check the current programme as the house also hosts cultural events, tours and occasional music or art sessions.