Harper's Ferry was the site of abolitionist John Brown's failed attempt to raid a federal arsenal and incite a rebellion of the surrounding enslaved population.
This may or may not have been part of the reason that the Smith Family visited. They also had friends, the Lovetts, who ran a hotel at Harper's Ferry, where this photo may have been taken.