The ruins of old Marib — the pre-Islamic Sabaean city — lie a few kilometres west of the modern town. Unlike the temples and dam, which are isolated monuments, the old city represents the dense urban fabric of the ancient capital: mud-brick buildings, narrow lanes, and the remnants of a palace complex. The city walls are still partially traceable.
The old city was inhabited from at least the 8th century BCE and was still active into the early Islamic period. Archaeological surveys have revealed multi-storey residential buildings, workshops, and what appears to have been a significant administrative quarter near the central area. The site is largely unexcavated and the mud brick structures are subject to erosion, but the atmosphere of walking through a silent ancient city surrounded by desert is considerable. Access requires a local guide.