The guard change at Horse Guards Parade is the less famous cousin of the Buckingham Palace ceremony, which is exactly why it can be better. The setting is open, the crowds are usually thinner, and you can often see the mounted cavalry without peering through railings.
The ceremony is weather-dependent, so do not build a whole day around it. If it is running, combine it with Whitehall, St James's Park, and Westminster Abbey.