The National Showcaves Centre for Wales is the strongest reason to stop in Pen y Cae. Dan yr Ogof is part of a much larger limestone cave system, but the visitor route gives a good, accessible taste of the underground landscape.
The surrounding attraction has family extras, but the caves are the point. Go for the scale of the chambers, the wet limestone, and the sense that the valley continues below ground as much as above it.