June to August is Lillesand's proper season: long evenings, boats in the harbour, open terraces, and the best chance of swimming weather. It is also when accommodation and restaurants are busiest.
May and September are quieter and can be lovely for walking and photography, though the water is cold and some seasonal services may be limited. Winter is peaceful but very subdued.