Live music is the reason to stay into the evening. Check current schedules before you build a night around one venue, then aim for at least one proper juke-joint set rather than treating the blues as something that ended in a museum case.
Ground Zero Blues Club is the easiest first stop, with regular shows and a downtown location. Red's Lounge is smaller, rougher, and closer to the Delta juke-joint idea many visitors came looking for.