Bacalar's Casa de la Cultura is a small cultural stop rather than a major museum. It is useful for local exhibitions, workshops, and occasional events, especially if you want something away from the water for an hour.
Check what is on when you arrive. The building and programme matter more when there is an exhibition or community activity underway.