Labuan's water village is a stilt settlement where houses, shops, and mosques stand over the shoreline. It is easy to visit without a boat: roads lead to the entrances, and from there you can walk the wooden lanes over the water.
The draw is the everyday texture of the place rather than a single monument. Go slowly, stay respectful around homes, and use it as a counterpoint to Labuan's war memorials and island beaches.