Stony Point is easiest by car. US 9W and the Palisades Interstate Parkway run north-south through this part of Rockland County, putting the town about an hour north of Manhattan in light traffic.
Public transport is possible but awkward for sightseeing. If you want the battlefield, riverfront, and Harriman edge in one day, drive or use taxis from nearby rail and bus connections.