Hongshi Gorge, a few kilometres east of Yulin city, is a canyon cut through red sandstone in which forty-four cave dwellings have been carved into the cliff faces at various heights, together with carved inscriptions in stone that date from the Ming Dynasty through the Qing. The name means "red stone gorge," and the colour of the rock — a warm terracotta, unusual in this region of yellow loess — makes it visually distinctive. The canyon is narrow enough that the cave mouths on opposite walls are within shouting distance of each other.
The caves vary in size from small sleeping chambers to larger rooms with carved niches and inscribed tablets. Many of the inscriptions are still legible, recording the names of governors, generals, and garrison commanders who used the site. The larger carved inscriptions on the cliff faces include poems and calligraphy from the Ming and Qing periods. The site has not been heavily developed for tourism and retains a slightly untouched quality; the main challenge is simply scrambling up to the higher caves.
The gorge is a short taxi ride or bicycle ride from the Yulin city centre.