La Granja de San Ildefonso is a compact town built almost entirely around one attraction: the Royal Palace and its extraordinary gardens. The palace and grounds make a full half-day or even full day on their own; the town's glass factory and the surrounding Sierra de Guadarrama add further reasons to linger.