I don't mind if somebody comes up to me and shakes my hand, but if I'm in the middle of a restaurant and somebody asks me for a picture, I can be a jerk and say no, or I can say yes and draw more attention to myself, which is exactly the opposite of what I want.
I did a radio interview for a station in Connecticut or something, and it was the worst interview ever. It was all yes and no answers.