Why are some sighted people offended if they can't help me?

I run into this not infrequently. A random sighted person will ask if they can help me (usually across a street). I’ll tell them that they can’t, because…well…there’s nothing they can do, and reactions occasionally range from sadness to offense. I don’t suppose there’s a Flutherite or seven that could shed some light (har!) on this?