I also fear that,

but I guess that shooting in places where there are usually a lot of tourists, people get more used to it. That, and a long lens that won't look too menacing.