The Chinese Historical Society of America Museum tells the story of Chinese American life, migration, discrimination, community building, and cultural identity. Its exhibitions are especially useful before or after walking through Chinatown, since they add context beyond the neighborhood's shops and restaurants.
The museum is small enough to visit in about an hour, but the subject matter is central to San Francisco's history.